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1 Introduction 


Let n £ IN and M be a complete simply connected, n-dimensional manifold with 
Riemannian metric g. Let V be the Levi-Civita connection on M related to g , /?(•, •) be 
the distance function on Af, T X M be the tangent space of M at x € M, and T*M be the 
cotangent space. Denote by (•, •) and | • | the inner product and the norm over T X M related 
to g , respectively. Also, denote by TM = [J T X M , T*M = IJ T*M and C°°(M) the 

x£M x€:M 

tangent bundle, the cotangent bundle and the set of smooth functions on Af, respectively. 

Let T > 0, U be a metric space, and / : [0, T] x M x U —> TM and /° : [0, T] x M x U —> 
]R be two functions (satisfying suitable assumptions to be given later). Given go £ M, let 
us consider the following control system 

f y(t) = fit, y(t),u(t)), a.e. t £ [0, T], 

\ y( o) = yo, 

where y(t ) = 4y(t) for t £ [0, T], and y(-) and u(-) are the state and control variables 
valued in M and U, respectively. The cost functional associated with (1.1) is 

T 

J( u (-))=[ f°(t,y(t),u(t))dt. (1.2) 

Jo 

In (1.2), u(-) belongs to the following admissible control set 

U a d = { u (0 : [0, T] —>■ U; u(-) is measurable}. (1-3) 

Clearly, this is the situation without endpoint constraints. 

We shall also consider the control system (1.1) with the following endpoint constraint 

y(T) = yi, (1.4) 

for some given y± £ M. The corresponding admissible control set is then given by 

Vad = {u(-) £ U ad \ y u (T) = 2 / 1 }, 

where y u (-) is the solution to (1.1) associated to the control u(-)(£ U a d)- 

In this work, we shall consider the following two optimal control problems: 

Problem I To find a u (-) £ U a d such that 

inf (1.5) 

u(-)€U ad 

Problem II To find a u(-) £ V a d such that 

J(u(-))= inf J(u(-)). (1.6) 

<)ev ad 
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For each of the above problems, we call u(-) an optimal control, the corresponding 
solution y(-) to (1.1) an optimal trajectory, and an optimal pair. Clearly, each 

of the above two optimal control problems can be viewed as an optimal control problem 
with state constrained on a submanifold of the Euclidean space. 

One of the central topics in control theory is to establish necessary and sufficient 
conditions for optimal controls. As that in calculus, one can derive the first-order necessary 
condition for optimal controls, as done in the classical monograph [32], even for some 
situation of state constraints. Nevertheless, for some optimal control problems, it may 
well happen that the first-order necessary conditions turn out to be trivial. In this case, 
the first-order necessary condition cannot provide enough information for the theoretical 
analysis and numerical computation, and therefore one needs to study the second (or even 
higher) order optimality conditions for optimal controls. 

There are many works addressing the second order necessary and sufficient conditions 
for optimal control problems in Euclidean spaces, such as [2, 4, 8, 13, 14, 15, 16, 17, 20, 
21, 23, 26, 27, 28, 29, 35] (in which [2, 8, 15, 21, 29] are five research monographs) and 
the references therein. Among them, we mention several works, in which the controls are 
subjected to some restrictions: Warga [35] considers a control system with the control 
set in a compact metric space. Frankowska and Tonon [13] investigate the second order 
necessary conditions when a smooth endpoint constraint is presented and the control set 
is a closed subset of an Euclidean space. For the case that the control set is a general 
metric space, Lou [26] considers a control system without state constraints. For the case 
that the state (or mixed state-control) satisfies inequality or equality constraints, we refer 
to [3, 19, 30] and so on. 

For the control system whose state is constrained to a manifold, there are also some 
literatures (e.g. [1, 5, 6, 7, 33] and the references therein) devoted to the second order 
necessary and sufficient conditions for optimal controls when the control set is an open 
subset of some manifold. Agrachev and Sachkov show a Legendre-type second order 
necessary condition for optimal controls, i.e., the Hessian of the corresponding Hamiltonian 
function with respect to the control variable is semi-negative definite (see [1, Theorem 20.6, 
p. 300 and Proposition 20.11, p. 310]); also, they give a strong Legendre-type second 
order sufficient condition for an optimal controls for sufficiently short time intervals, i.e. 
the Hessian of the corresponding Hamiltonian function with respect to the control variable 
is negative definite (see [1, Proposition 20.12, p. 311 and Theorem 21.8, p. 347]). On the 
basis of the second order optimality conditions, Bonnard, Caillau and Trelat [5] present 
an algorithm to compute the first conjugate time along a smooth extremal curve, at 
which the trajectory fails to be optimal. In [33, Chapter 4], Schattler and Ledzewicz 
provide a “state of art” account on the second order necessary and sufficient optimality 
conditions for a class of control-affine systems (Also, we refer to [6, 7] for relatively earlier 
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works). Nevertheless, compared to the case of flat spaces, the picture of second optimality 
conditions in the curved spaces is, in our opinion, quite incomplete. For example, it 
would be quite interesting to extend the related results in the flat spaces (say, that in 
the research monographs [2, 8, 15, 21, 29] on second order optimality conditions) to the 
setting of curved spaces but many things remain to be done. 

The main purpose of this paper is to investigate the second order necessary and suf¬ 
ficient conditions for optimal control problems evolved on Riemannian manifolds. We 
distinguish the problems into two cases. The first case is when the endpoint is free, i.e., 
the case without the condition (1.4). For this case, we consider the control systems with 
considerably general control sets. By means of the needle variation technique, we obtain 
the second order Taylor’s expansion of the cost functional with respect to the control vari¬ 
able via the Riemannian geometric tools, introduce a second order dual equation which 
depends on the curvature tensor of the manifold, and obtain second order necessary con¬ 
ditions for optimal controls of integral and pointwise form respectively. In addition, we 
obtain the second order sufficient condition of integral form for local optimal controls. 
The second case is when the endpoint is fixed, i.e., the condition (1.4) is imposed. For 
this more difficult case, as in [1], we assume that the control set is open, and consider 
an extended control system involving an extra unknown variable associated to the cost 
functional. There is a well known relation between the optimal controls of the original 
optimal control problem and the above extended control system (e.g. [1, p. 179, Section 
12.4]): the terminal value of the trajectory of the extended control system corresponding 
to an optimal control must be at the boundary of the attainable set of this control system 
at the terminal time. Thanks to this relation, Agrachev and Sachkov [1] observe that, the 
key point of finding second order optimality conditions for the original optimal controls is 
to analyze the Hessian of the endpoint mapping of the extended control system with re¬ 
spect to the control variable. Following this idea and employing again some tools from the 
global geometry, we compute an explicit expression of this Hessian (see (6.52)), and obtain 
the desired second order optimality conditions, which, as the case of free endpoint, contain 
also the curvature tensor along the optimal trajectory. Note that the above mentioned 
explicit expression is absent in [1], 

From the viewpoint of Riemannian geometry, it is quite natural that the curvature 
tensor appears in the second order optimality condition, see Synge’s second variation 
formula for geodesics (e.g., [31, Theorem 21, p. 158]). Nevertheless, one of the main 
difficulties for our control problems is to compute the second order Taylor’s expansions 
(of the perturbed trajectories), i.e., (5.3)-(5.4) and (5.23), with convenient and explicit 
expressions of the second order terms, which, in principle, should involve the curvature 
tensor. To do this, quite different from the flat spaces, we need to establish a key geometric 
lemma, i.e, Lemma 2.3. This lemma enables us to obtain the second order variational 
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equations, i.e., (5.2) and (5.22), whose solutions are exactly the desired expressions of 
the above mentioned second order terms. Clearly, the curvature tensor does appear in 
these two equations. It seems to us that Lemma 2.3 has some independent interest and 
may be applied in other places. Another difficulty in our Problem I is how to introduce 
suitable dual equations such that the second order Taylor’s expansion (6.5) (of the cost 
functional) can be rewritten in terms of the dual variables. This is the key to obtain the 
corresponding second order optimality condition. It is not difficult to single out the first 
order dual equation (3.7) (because, at least formally, it is the same as that for the flat 
spaces), which is employed to rewrite the first order term in (6.5) (see (6.6)). For the 
second order term (6.7), there are some quadratic terms of the first order variation X e (-) 
(see (6.10)). Similar to the setting of flat spaces ([26]), one needs to find some second 
order dual equation to “cancel” these quadratic terms. Different from the flat setting and 
interestingly, the curvature tensor appears in our second order dual equation (3.8). 

It is worth mentioning that, compared to the corresponding results in the Euclidean 
spaces ([2, 4, 8, 13, 14, 16, 17, 20, 21, 23, 26, 27, 28, 35]), the curvature tensor along 
the optimal trajectory appears precisely in our results (Theorems 3.1 3.4). This shows 
the very difference between the curved and the flat spaces from the viewpoint of optimal 
control theory. Also, our results for Problem II (i.e., Theorems 3.3-3.4) are different from 
[1, Theorem 20.6, p. 300, Proposition 20.11, p. 310 and Theorem 20.16, p. 317] and [1, 
Proposition 20.12, p. 311 and Theorem 21.8, p. 347]) at least in two aspects. Firstly, our 
second order optimality conditions depend on the curvature tensor, which does not appear 
explicitly in [1]. Secondly, our Theorem 3.4 guarantees the local optimality of a control in 
any time interval, while the corresponding result in [1] works only for a sufficiently short 
time interval. 

In order to show the differences between our main results and that in the previous 
works, we shall provide two illustrative examples, i.e. Examples 4.1-4.2. Example 4.1 is 
about an optimal control problem on a non-compact manifold with negative curvature and 
with a discrete control set. We show that this problem fulfils all the assumptions in our 
main results. In Example 4.2, we apply one of our main results, i.e., Theorem 3.3, to the 
following famous geometric problem: Given any two points on a Riemannian manifold, 
find the necessary conditions of a locally shortest curve connecting these two points. We 
conclude that this curve must be a geodesic and satisfies the second variation of energy, 
which is consistent with the corresponding results in Riemannian geometry (see [31, p. 
159]). However, the Legendre-type second order optimality condition in [1, Theorem 20.6, 
p. 300 and Proposition 20.11, p. 310] becomes trivial for the same problem (see Remark 
4.1 for more detailed analysis). 

Though geometric control theory is a huge subject and there exist many works on 
control theory via differential geometry, it seems to us that the more delicate tool, i.e. 
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Riemannian geometry, has rarely been used to the study of ordinary differential equation 
control problems. As far as we know, this work is the first one which links explicitly the 
curvature tensor of the manifold to the optimality conditions. It seems us that this may 
stimulate further work employing Riemannian geometry to the study of control problems. 

The rest of this paper is organized as follows. In Section 2, for the reader’s convenience 
we recall first some basic notions and results on Riemannian manifolds, and also we show 
two lemmas which will be useful later. The main results of this paper are stated in Section 
3. In Section 4, we give the above mentioned two examples. In Section 5, we obtain the 
first and second order variations of a trajectory of the system (1.1), by means of two class 
of variation techniques, i.e., the needle variation and the classical variation. Sections 6 is 
devoted to proving our main results in this work. 

One of the main results in this paper, i.e., Theorem 3.1, has been announced in [9] 
without proof. 

2 Some preliminaries 

2.1 Exponential map 

For this part, we refer the readers to [12, Chapter 3] and [36, Chapter 3]. 

A differentiable curve y(t) on M with t £ [0, a) (for some a > 0) is called a geodesic 
if it satisfies 

Vy(i) 7 (i) = 0, t £ [0, a). (2.1) 

Let x £ M be fixed. For any v £ T X M , there exists a unique geodesic j v (-) satisfying that 
7„(0) = x and 7„(0) = v. Let [0, £ v ) be the maximal interval on which 7„(-) is defined. Let 
O x C T X M be the set of vectors v such that l v > 1. Then one can define the exponential 
map as follows 

exp^. : O x -> M, exp x v = 7„(1). 

It can be shown that O x is a neighborhood of the origin O £ T X M , and exp^ maps straight 
line segments in T X M passing through the origin O £ T X M to geodesic segments in M 
passing through x. For any v £ T X M , the differential of exp x at v is a linear map, denoted 
by 

dexp x |„ : T V T X M —> T exPxV M, (2.2) 

where T V T X M denotes the tangent space of the manifold T X M at the point v £ T X M. 
Given an e > 0, write 

B(0,e) = {v £T x M; |u| < e} and B x (e) = {y £ M; p(x,y) < e}. (2.3) 

We call i{x) = sup{e > 0; The map exp z : B(0,e) —> B x (e ) is diffeomorphic} the 
injectivity radius at the point x (e.g., [31, p. 142]). 


6 



We list the following properties of the exponential map, which can be found in many 
books on Riemannian geometry (e.g. the proof of [12, Proposition 2.9, p. 65]). 


Lemma 2.1 For any x £ M, the map exp x is a local diffeomorphism, whose differen¬ 
tial at the origin O £ T X M satisfies 


d exp x | q = dexp x 1 


the identity operator on T X M. 


(2.4) 


\X 

Furthermore, for any y £ M with p(x,y) < i(x), there exists a unique shortest piecewise 
smooth curve which is also a geodesic in M, connecting x and y. 


2.2 Parallel translation and tensors 

For the details of this part, we refer the readers to [22, Chapter I and Chapter III ], [31, 
Chapter 2], [36, Chapter 1] and [18, Chaper 1], 

For any x £ M and r,s £ IN, a multilinear map 


F : T*M x • • • x TfM x T X M x • • • x T X M -> R 

-v---' v -7--—' 

r times s times 

is called a tensor of order (r, s) at x. Denote by 7J (x) the tensor space of type (r, s) at x. 
A tensor field T of type (r, s) on M is a smooth assignment of a tensor T(x) £ Tf (x) to 
each point x of M. The norm of T at x £ M is defined as follows: 


\T(x)\ = sup {7»(Yi, • • • ,v r , Ai, • • •, A s ); Yj £ T* X M , A; £ T X M, 

(2.5) 

\Yj\ < 1, |A Z | < l,j = 1, l = 1, — , s}, x £ M. 

Denote by Tf (M) the set of all tensor fields of type (r, s) over M. 

Let 7 : [0, £} —> M be a differentiable curve with 7 ( 0 ) = x £ M, j(£) = y £ M and 
£ > 0. Given a vector v £ T X M, there exists a unique vector field X along 7 satisfying 


V-y( s )AT = 0, VsG [0,f], A(0) = v. 

The mapping T X M X('}(£)) £ T y M is a linear isometry between T X M and T y M. 

We call this map the parallel translation along the curve 7, and denote it by Lf y v. The 
parallel translation along the curve 7 enjoys the following property: 


{Ll y X u Ll y X 2 ) = {X 1 ,X 2 ), V X\,X 2 £ T X M. (2.6) 

For any y £ TfM, we define Lf y r) £ T*M by Lf y y(X) = y({L'f y )~ l X) for any X £ T y M. 
One can extend the parallel translation of a vector at x £ M along the curve 7 to a tensor 
T£Tf(x) by 

LlyT{v 1 , • • •, u r , 771 , •••,%) = T{(Ll y )~ 1 v lf • • •, (Ll y )- l v r , (L^r V, ■ ■ •, (L^) -1 ^), 
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for all vi, ■ ■ ■ , v r £ T*M and rji, ■ ■ ■ , rj s £ T y M. From the above formula, one can get 

T{v\ , • • • , V r , ?7l j ‘ ‘ ‘ i Vs ) L xyT~ ’ ’ ’ ’ ) ^xyVl i ' ' ' ? ^xyVs^j ■ (^-7) 

for any v\, ■ ■ ■ ,v r £ T*M and r/i, ■ ■ ■, r/ s £ T X M. Especially, from (2.5), (2.6) and (2.7), it 
follows that 


|X| = |^I, l A l = I^A|, Vl£ T X M, XeT*M. (2.8) 

In particular, if p(x,y) < min{i(x), i(y)}, according to Lemma 2.1, there is a unique 

shortest geodesic 7 connecting x and y. In this case, we use L xy instead of L^y for 
abbreviation. 

Let T be a tensor field. Take any v G T X M. Let 7 be a smooth curve such that 
7 ( 0 ) = x and 7 ( 0 ) = v. Then the covariant derivative of a tensor held (in terms of parallel 
translation) is defined as follows (see [18, p. 42]): 

V ’ T = \ - r M) ■ ( 2 - 9 > 

Denote by VT the covariant differential of T, which is a tensor held of order (r, s + 1 ), 
and is defined by (see [22, p. 124]) 

VT(Yi, • • •, Y r , Ai, ■ ■ ■, A s , Z) = V z T(Yi, ■ ■ ■, Y r , Ai, • • •, A s ), ( 2 . 10 ) 

for all Yi, • • •, Y r £ T*M and Ai, ■ ■ ■, A s , Z £ TM. Applying [22, Proposition 2.7, p. 123 

and Proposition 2.10, p. 124 ], one can get the following property: For each Z £ TM , one 
has 

VzT(Yi, ■ ■ ■ ,Y r ,Xi, - ■ ■, A s ) 

= z(T{Y u ■ ■ ■, Yr, Ai, ■ • •, A s)) - T(VzY u Y 2 , • • •, Y r , Ai, • • •, A s ) 

v J ( 2 . 11 ) 
-T(Yi, • • • ,\7zY r , Ai, • • •, A s ) — T(Yi, ■ ■■ ,Y r , VzAi, A 2 , • • •, A s ) — • • • 

—T(Yi, ■ ■ ■ ,Y r ,Xi,- ■ ■, VzA s ), V Yi, • • •, Y r £ T*M, X\, - ■ ■ ,X S £ TM. 

In particular, a smooth function / £ C°°(M) is a tensor of order (0,0). V 2 / is a tensor 
of order (0,2). We call this tensor the Hessian of the function /, which is a symmetric 
tensor, and can be computed by 

Y 2 f(x)(X,Y) = Y(x)(Xf) — (V Y ( x )X)f, x £ M, X,Y £ TM. (2.12) 

For a smooth function h : M x M —» M of two arguments, we denote by Vjh the covariant 
derivative of h with respect to the i th argument with i = 1,2, i.e., for X £ TM and 
(xi, X 2 ) £ M x M, 


(Vih(x i,x 2 ),X(xi)) = X(xi)h(xi,x 2 ). 


( 2 . 13 ) 



Moreover, we define higher order derivatives of h as follows: For i. j = 1,2, i ^ j, any 
(xi, x 2 ) G M x M and X, Y, Z G TM, 

V i V j h(x 1 ,x 2 )(X,Y) = Y( Xi )[x( Xj )(h(x i,* 2 ))) = Y(x i )({V j h(x 1 ,x 2 ),X(x j ))y, 
V 2 h(xi,x 2 )(X,Y) = Y(xi)(x(xi)h(x i,x 2 )) - V Y ( Xi )Xh(x i,x 2 ); 

(2.14) 

v-Vj/i(xi,x 2 )(x,r,z) = vU(x(x j ),v j h(x 1 ,x 2 )))(Y,zy t 

vrfhix !,x 2 )(x, y, z ) = Z(x0 (y)h{x 1, X 2 )(x, y)) . 

Let us recall the definition of the product of tensors (see [22, p.22]): 

r <8> £ = Xi <g> • • • (8) ® y <g> - • • ® Y p <g wi ® - - - 0 0J S 0 rn ® ■ ■ • <g> 77, G 7^ (M), (2.15) 

where T = Xl< 8>- • -(g>X r (guqig)- • -(g>c<; s € 7J(M), /C = Yi<g>- • • <g> 1),<8>7?i<8>• • -(8>r?q G T^(M) 
and r, s,p,q G IV. For any i, j € LV, denote by df*- 7 the contraction of the zth contravariant 
index and the jth covariant index, which is a linear mapping from 7J(M) to TjY\ (M) 
with 1 < i < r and 1 < j < s, and is defined by ( see [18, p.IT]) 

£ ij (Xi <g> • • • <g> <g> ui <g> • • • <g> u s ) 

= u>j(Xi)X 1 <g> ■ ■ ■ <g> Xi_ 1 (8> Xj + i <8) • • • (8> X r (g> ui <8> • • • <8> uij~ 1 <8> Uj+i <S> ■ ■ ■ <S> cu s , 

(2.16) 

for all Xi, • • • X r G TM and uq, • • •, cu s G T*M. 

2.3 Two useful lemmas 

We begin with the following technical result (in which, (2.18)—(2.19) and the first equality 
in (2.17) can be found in [10]). 

Lemma 2.2 For any x,y G M with p(x,y) < min{i(x), i(y)}, X,Xi,X 2 G T X M and 


Y G T y M, it holds that 

[exp' 1 y\ = [exp.^xl = p(x,y), X Xl L x .X = 0, (2.17) 

Vip 2 (x,y) = —2exp“ 1 y, X 2 p 2 (x,y) = - 2exp~ 1 x, (2.18) 

L xy exp~ l y = —exp~ l x, L xy d 1 p 2 (x,y) = -dip 2 (y,x), (2.19) 

ViV 2 p 2 (x,y)(y,X) = -2(dexp- 1 \ x X,Y), (2.20) 

(ciexp" 1 Y, X) = (ciexp" 1 X,Y), (2.21) 

y * x 


Vi X 2 p 2 (x,y)(Y,X) = -X 2 p 2 (x,y)(L yx Y,X) - (X lP 2 (x,y),X x L y .Y), (2.22) 
V 2 p 2 (x, x)(Xi,X 2 ) = V|p 2 (x,x)(W 1 ,X 2 ) = 2(X 1 ,X 2 ), (2.23) 

ViV 2 p 2 (x,x) = V 2 V i p 2 (x,x) = Vfp 2 (x,x) = 0, *,j = l,2, i^j, (2.24) 
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where the notions V 1 V 2 p 2 , X 2 Vjp 2 and ViX 2 p 2 with i,j = 1,2 and i j are defined in 
(2.14)> V 2 p 2 is the Hessian of p 2 with respect to the i th argument, Xfp 2 is the covariant 
derivative of the Hessian V 2 p 2 (x, x) with respect to the i th argument (see (2.10)), and dj 
stands for the exterior derivative of a function on M x M with respect to the i th argument 
for i = 1, 2. 

Proof: We only prove the second equality in (2.17), and (2.20)-(2.24). 

Let 71 be a radial geodesic satisfying 71 ( 0 ) = x and 71 (0) = X\. Then, 71 is the 
shortest geodesic connecting 71 (s) and x, provided that s > 0 is small enough. By (2.9), 
we have 

Vx.^.X = fon - X) = 0, 

which gives the second equality of (2.17). 

Let 7 and fi be the curves satisfying 

7 (0) = x, 7 ( 0 ) = X, = y , m = Y. (2.25) 


By (2.14) and noting (2.18), we have 

r\ r\ r\ 

X 1 V 2 p 2 (x,y){Y,X) = p 2 ( 7(0),/?(r))|e= r =o = ^(V 2 p 2 ( 7 (0), /8(0)),4(0))| e 

= l{0),Y)\ e=Q = —2(dexp“ 1 \ x X,Y), 

which implies (2.20). Based on the above identity, (2.18), (2.19) and (2.6), we have 
Vi V 2 p 2 (x,y)(Y,X) = -2 ^(L ym exp ^(0), L yi{e) Y)\ 0=o 

= -§e ( yip 2 ^ y) ’ L yY<» Y ) L =0 

= -(XxVip 2 (;y),L yx Y) - (V lP 2 (x,y),X x L y .Y), 


which, together with (2.10), implies (2.22). 

To prove (2.21), we recall (2.25) and the definition of the differential of a differentiable 
map, apply (2.18) and get 


(dexp^ 1 Y,X) = (dexp^j, 1 /3(0), X) = (—exp x l fi{r) X) 






r =0 = -^W‘Ym^ir)) 


Similarly, we get (dexp 1 X,Y) = —\-n-4nP 2 {^{0) 1 fi{r)) . These two equalities 

y x z or at) 9 = r =0 

imply (2.21). 
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To prove (2.23), we choose the normal coordinates {xi, ■ ■ ■ ,x n } at x such that 



for i. j = 1, • • •, n. From the above property, we can further deduce that 


_d_ 

dxi 


9kl(') = 0, 

X 


(2.26) 


(2.27) 


with gid(-) = where i, k, l = 1, • • •, n. By some computation in this system 

of local coordinates, we obtain (2.23). 

Then we go to the proof of (2.24). For any y which is sufficiently close to x and any 
vector Held F, recalling (2.14), we have 


V?V 2 p 2 (y,z)(F,-,.) =V?(v 2 p 2 ( 2 /,x)(F))(.,.) = -Vf(Vi / 9 2 ( 2 /,x)(L^F))(.,.), 


where we have used (2.7), (2.18) and (2.19). Let us compute the right hand side of 
the above identity in local coordinates. By the property of the normal coordinates 
{xi, • • •, x n }, we have p 2 (x, y) = | exp” 1 y | 2 = Ya =i x i(v)- For any z which is sufficiently 


close to x, denote 


d 


L *y F = '52 a i( z ’y)faT.(y)’ 


i—1 


where at(z,y) is a function depending on z and y. Then, 


(2.28) 


d 

Vi p 2 {y,x)(L xy F) = L xy F(p 2 (-,x)) = E a j {x,y)—(y)(x 2 {-)) = 2^2a i {x,y)xi{y). 


i,i= 1 


8Xn 


i= 1 


For any vector fields Xj(-) = Ylk=i -^j(‘)^:(‘) with j = 1,2, noting (2.12), (2.19) and 
(2.26), we obtain that 

n o2 

V 2 1 V 2 p\x,x)(F,X 1 ,X 2 ) = - 2 E X l(x)X[(x)-——\Jam(x,-)x m (-j). 


k,l,m= 1 


We claim that 


E ^(x)X[( a 


d 2 


k,l,m=l 


dx k dxi 


(a m (x, ■)x m (-)) = 0. 


(2.29) 


In fact, according to (2.26), (2.27) and (2.28) we have 


d 

dxk 


a m (x,-) — J2i= 1 Q Xk X { a i( x -’ ')ffim(-)) — dx k 


= (Vj_ l L x .F,^ 


where k = 1, • • • ,n. By the second equality of (2.17), we have a m (x, •) = 0, which 
implies V 2 V 2 p 2 (x,x) = 0. Using the same method, we can show that V 2 V 2 p 2 (x, x) = 0, 
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V 1 V 2 p 2 (x,x) = 0 and V 2 Vi/> 2 (x, x) = 0. We now prove that X\p 2 (x,x) = 0. For this 
purpose, we take any y(£ M ) which is sufficiently close to x. For any Y £ T y M and 
j,k = 1 , • ■ ■ ,n, letting g|^-(x) act on both sides of (2.22) with X = we obtain that 


v?v^(x,»)<y, £,.*_) 

-Vlp 2 (x,y)(L yx Y, ° 


d 


' dxj ’ dxk 


- (Vi p 2 (x,y),V_d_X_a_L y .Y), 


dxdxj 


where we have used (2.11) and (2.26). Letting y approach to x, and using (2.17), (2.18) and 
V 1 V 2 p 2 (x,x) = 0, we conclude that X\p 2 (x,x) = 0. Similarly, we can get p 2 (x,x) = 0 
in the same way. □ 


Denote by [ X , Y] = XY — YX the Lie bracket of vector fields X and Y. Denote by R 
the curvature tensor (of ( M,g )), which is a correspondence that associates to every pair 
X, Y £ TM a mapping R(X , Y) : TM —»• TM given by 


We write 


R(X, Y)Z = VxVyZ - XyXxZ - V [X ,Y] Z , TM. 


R(X, Y, Z, W ) = {R(X, Y)Z, IF), V X, Y, Z, IF € TM. 


For any x £ M and X(x),Y(x) £ T X M with X(x) D( x )> the sectional curvature 
sec(X(x),Y(x)) (of the plane spanned by X(x) and D( x )) i s given by 


sec(X(x),Y (x)) = 


R(X,Y,Y,X)(x) 


\X(x) /\Y(x)\ 2 
The following result will play a key role in the sequel. 


(2.30) 


Lemma 2.3 Let X,V,F£ TM. Then, for any x € M , it holds that 

Vx(x) (d x {L x .F{x))V{x)) = ^R(X , V)F(x) 1 ; (2.31) 

V 3 2 V iP 2 (x, x)(X, F, V, V ) + V|V 2 p 2 (x, x)(X, F, V, V) = 2R(X, V, F, V)(x). (2.32) 

J The left hand side of (2.31) is defined as follows: For y £ M closing enough to x, we view 
L.yF(-) : B x (i(x)) —> T y M as a map, where B x (i(x)) is defined in (2.3). The differential of L. y F(-) 
at a; is a linear map, denoted by d x (L xy F(x)) : T X M —> T Lxy F(x)T y M , where T L F ( x yT y M is isomorphic 
to T y M. Therefore, we have d x (L xy F(x))V(x) £ T y M. Letting y vary around x, we get a vector field 
d x (L x .F(x))V(x) around x. Hence, Vx(,j ^d x (L x .F(x))V(x)^ is the covariant derivative of vector field 
d x {L x .F{x))V[x ) relative to X(x). 
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Proof: We will prove (2.31) and (2.32) by means of suitable local coordinates. 

Let {xi, ■ ■ ■ ,x n } be the normal coordinates in a neighborhood O C M around x, which 
satisfies (2.26) and (2.27). Denote by (gij)(-) = ((^-, g§-)(-)) and ( i,j,k = 1 , •••,n) 

the metric matrix and the Christoffel symbols, respectively. Take any rn, j £ {1, • • • , n}. 
Let Xj(-) be the coordinate curve such that j^r-(x) = Xj( 0) (See [12, p. 8]). Recalling 
(2.13), (2.28) and the definition of the differential of a differentiable map, for any y £ O, 
we have 


d d ^ d d 

d x (L xy F{x)) — (x) = —\L x . {s)y F{ Xj {s )) = £<Vi <h(x,y),—(x)) — (y), 


dx.j 


dxj 


u j i=1 ^j 

where V;aj(-, •) (with l = 1,2 and i = 1, • • •, n) is defined in (2.13). Then, recalling (2.26) 
and (2.14), we have 


d ^ d d d 

Vj. w (4MW ) S -(»)) (2.33) 

J 1=1 J 


Clearly, to obtain (2.31), we need to compute V 2 Via^(x, x) q§^) f° r £,j,ra — 
1, ■ ■ ■ ,ra. To this end, we first show some properties of short geodesics. Given z,y £ O, 
write V = exp J 1 y and ^ zy {s) = exp z sV with s £ [0,1]. Then, j zy (-) is the shortest 
geodesic connecting z and y, and satisfies 7 22 / ( 0 ) = z, 7 2 ?/ (l) = y and 7 2 ?/ ( 0 ) = expj 1 y. 
We assume that the local expression of 7 zy (s) with s £ [0,1] in the system of coordinates 
(O, xi, ■ ■ ■ j x n ) is as follows: 

(7i(*),-".72>))- 

Then, 7 zy (s) = E"=i 7z V ( s )^J ( 7 zy( s ))- In particular, by Lemma 2.2, recalling the defini¬ 
tion of a geodesic and using the local expression of 7 Z2/ (-), we have 

n ■ d 1 1 9 

7*1/(!) = (y) = L zyizy(0) = L zy exp” 1 y = --L 22/ Vip 2 ( 2 :, y) = -V 2 /j 2 (^, y), 

i =1 ® 

(2.34) 

which implies that 7 *^( 1 ) with % = 1 ,- • ■ ,n are determined by the endpoints of geodesic 
r / zy {-)- Thus, we may view 7 ^ (1), • • •, 7 ” (1) as functions of the first argument z and the 
second argument y. 

We claim that (Recall (2.13) and (2.14) for the notations) 

(V 22 4(l), F-(y)) =Sj+o( 1), <V,-)4(1), dL w > = -sj + 0 ( 1 ), (2.35) 


ViV 2 74(1)=o( 1), Vli4(l) = o(l), (2.36) 

for (, j = 1, • • • ,n, where Sj is the usual Kronecker symbol, o(l) is a tensor of suitable 
order satisfying lim^a, o(l) = 0. Indeed, for any j = 1, • ■ -, n, it follows from (2.34) that 

-(V 2 y 2 (z,y),—(y)} = ^( 7 ^(l)_(y),_(y)). (2.37) 
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Letting -(y) act on the above identity, by (2.11), we get 

1 o 2/ w d d 1 . O/ x „ d 

2 Vrf 2 {X,2P ~ (Z ' V) - V ^ 


dx ( (y) dxj ‘ 


Z (( v 27* 1 ,( 1 ), -^(y))9ij(y) +Y zy {i)-£ r ^y)g ij ). 


d 


i =1 


According to (2.17), (2.18), (2.23), (2.24), (2.26), (2.27) and the fact that 

7L( 1 )= 0 > * = L---,n, 


(2.38) 


(2.39) 


we obtain the first identity of (2.35) by letting z = x in (2.38). In a similar way, we obtain 
the second identity of (2.35) by letting gfr(^) act on (2.37) at z = x with ( = 1, ■ ■ ■ ,n. 
For m = !,•■■ ,n, letting q^—(z) act on (2.38), via (2.11), we get 


dx 

Odd 


d d 


_ _ W ) + -V,V 2 /( 2 , ^( 2 

72 A o A A 

= Z (ViV^lX^-fe), Q^W)9iM + <Vi7^(l), 


2=1 




By Lemma 2.2, (2.26), (2.27) and (2.35), we obtain the first equality of (2.36) by taking 
z = x in the above identity. Similarly, we obtain the second equality of (2.36) by letting 
0 §—(y) (m = 1, • • •, n) act on (2.38) with z = x. 

Recalling the definition of parallel translation and (2.28), for any s € [0,1], we have 

72 9 

0 = V %y{s) L z .F(z)= Z Y Z y^)V^ (7zy(s)) (a c (z,-)—) 


i, C=1 


Z (Zl^i/( a )( V 2 a c(«>7*i/(s)),^-) 

C=i i=i 
n 

+ Z 7zy(s)a» ? ( 2: >7z2/(s))r^(7z ! /(s)))^(7z2/(s)), 

2,77=1 C 


9 


which indicates that 

72 Q 71 

Z^^KWcR^y),—} + Z T^ 1 )^^*/) 1 ^) =°> C = 


2=1 


Letting act on both sides of the above identity, via (2.11), we obtain that 


2,77=1 


Z (( V 27^(l),^(2/))(V 2 a c (2,y), £-(y)> +7^(l)Vio c («,y)(^7, ^ 

o 72 o 

+7^(l)(V 2 o c (z,y),V a ,N ^ / '” •’ 


d 


d d 


2=1 


' ^ dx , 


■)) + Z (( v 27^(i), w|-(y))ar ? (^,y)r^(y) 


2,77=1 


+7 ly(^){^2a ri (z,y), ^-(y))r^(y) + 7* J/ (l)a ?? (z,y)^ r (y)T i 


0x rn 

o v2//* i?7 

ux m 


(2.40) 


= 0. 
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Letting act on the above identity at z = x, we get 


Tl r\ r\ r\ 

—(x))V|a c (x,y)(- 


i —1 


' dxi ’ 9.x,i 


71 r\ r\ 

2 , 77=1 3 71 


IT) 


Tl r\ r\ r\ 

+ E(< V 27^(1),-—(y))ViV 2 a c (x,y)(—(y),—(x)) +o(l) 


2=1 


= 0, 


where we have used (2.11), (2.14), (2.26), (2.27), (2.36) and (2.39). Letting y approach to 
x , we obtain 

8 8 8 8 n 8 

ViV 2 a((x,r)(—(x),—(x)) = V|a f (x, x ){—, ^ a v (x, x)-—- (x)T^ 

uxm u,L j Udj j u,L rn rj=l UtL m 

(2.41) 

where we have used (2.35). For j = 1, • • • ,n, letting gf-(y) act on (2.40) with z = x, we 
get 


71 r\ r\ 


2=1 


dxi ’ dxj 


9 '+(V 2 7^(1 ),-^(y))X 2 2 a c (x,y)( 9 


d 


dxi ’ dx r 


+ E (<V27^(l), 

2 , 77=1 

+o(l) = 0, 


dx . 


9 (y))a^(x,y)^-(y)r£ ? + (V 2 7* J/ (l), ^-(y))a„(x, y)^-(y)F 


dx. 


8 x r 


where we have used (2.11), (2.14), (2.26), (2.27), (2.36) and (2.39). Letting y approach to 
x, we obtain 


d d 


d d 


v 2a c (x,x)(^, —) + V 2 a c (x,x)(—, —) 


dxj dx r , 



= 0 , 


where we have used (2.35). Since V 2 a, ? (x,x) is the Hessian of the function a v (x, ■) with 
respect to the second argument at x. it is a symmetric tensor of order (0,2). Therefore, 
we have 


. . , d d 

v 2 a < (x,x) ( —) 



(2.42) 


Recalling (2.33) and inserting the above identity into (2.41), we can get (2.31) with 
X = and V = where we have used the expression of the curvature tensor 

OX rn OX j 

in local coordinates (See [31, p. 41]), the property of the curvature tensor (See [31, 
p. 33]), (2.26), and the definition of a,j(x,x ) with j = 1, • • • ,n. It is easy to check that 
Vx(x) ( d x {L x .F(x))V (x)^j with X, V € TM is multi-linear with respect to X and V. Thus, 
the proof of (2.31) is completed. 
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To obtain (2.32), for any y G O, we apply (2.22) and get 
V 1 V 2 P 2 (x,y)(F(y), g §-(*)) 


= -X7 2 1 p 2 {x,y)(L yx F(y), J-(x)) - (Vip 2 (x, y), V_|_ (a;) (^.^(y))). 


Letting 


9 

dx y 
2 J2 


(y) (1 < k < n) act on the above identity, via ( 2 . 11 ), we can get 

9 (n,\ 9 („\\ I Y7.V. n.\(T7 „ z? 9 


V 1 V|p 2 (x,y)( J F(y),^(y),^-(x)) + V 1 V 2 p 2 (x,y)(V Bi _ ( 2 /)J F,^-(^)) 

+V 2 Vfp 2 (x,y)(L ya; F(y), gf-(x), gg-(y)) + V?p 2 (x, y)(d y {L yx F{y))^- k {y), £~(x)) 


= -V 2 V lP 2 (x,y){V^_ {x) (L y .F(y)),^- k 
Vip 2 (x, y), V_ 8 _ (x) ( d y {L y .F{y))^- k 

Moreover, letting -(y) act on the above identity, as y approaches to x, we can get 


VxV^Or,x)(F, • V 1 V 2 y 2 (x,x)( V^ (S) V^F, £(* 


cfo*. ’ dxk ’ - 

+ V|V?p=( ;E , a; )(J’. ji-, gf_, jJj) 


+vfp 2 (x,x)(<i„('4( i !/*- F, fe))sr(!/))srfe)lB.«.s-W) 


(2.43) 


where (2.17), (2.18) and (2.24) are used. 
We claim that 


V 1 V^(x,x)(v^ w V j| _F, 4 (x)) 

~^^iP 2 ( x ^ x ){dy\d y (L yx F(y))-^-(yfj -£^(y)\y=x, ^j( x )) = 0- 


(2.44) 


In fact, by (2.28), we may rewrite F(y) as F(y) = L yy F(y) = £«=i a v {y,y)jfr{y), and 


compute V_g_,, y jF as follows: 

dxu 


V 


dx. 


-(y) F = ^r,= 1 ((Vi«fy(y,y), ^(y)) + (V 2 a„(y,y), -£r k {y)))^(y) 


+ E n n ,(=ia v (y,y)Tk ri ^{y)- 


Applying Lemma 2.2, and by (2.26) and (2.27), we have 


V / ■) V _g_ F 


= E?.i (vKfe.J/Kij, gj-) + 2 V 1 V 2 o,( 9 . 9 )(Jj, Jj) ( 2 . 45 ) 

+vKto. ^>)4 (#)+<.,(», +ofi), 

where lim o(l) = 0. On the other hand, to figure out d y {d y {L yx F[y))-^-\ 


977 (y) with 

y closing to x, we choose a geodesic y(-) on M satisfying 7 ( 0 ) = y and y(0) = g§-(y). 
Then, 


d y (L yx F (y)) 


3 


3 


9 


&[ (l,) = t 0 Ea,( 7 W.x)^-W = E(V.»i(!/,*), 


d 


d 


i= 1 


2=1 
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(2.46) 


and 

dy(d y (L yx F{y))-^(y)}£-{y) - 0 Sill {Via,(7(5), x), 

= Eti vfoife.xK^jfe), £(»))£(*) + <-(!)• 

Inserting (2.46) and (2.45) (with y approaching to x) into the left hand side of (2.44), via 
Lemma 2.2, (2.41) and (2.42), we get (2.44). 

Inserting (2.44) into (2.43), via Lemma 2.2 and (2.31), we can get (2.32) with X = 
and V = g§£. It is easy to check that V 3 2 V lP 2 (x, x)(X, F, V, W), V|V?p 2 (x, x)(X, F, V, W) 
and R(X , V, F, W)(x) with X, F,V,W G TM are multi-linear with respect to X , F. V and 
W. Hence, the desired identity (2.32) follows. □ 

In particular, when M is a two dimensional Riemannian manifold, we can employ 
Gauss-Bonnet Theorem to prove (2.31). 

Lemma 2.4 Assume that M is a two dimensional Riemannian manifold. Let X , V, F 
€ TM. Then, for any x G M, it holds that 

X x{x) (d x {L x .F(x))V{x)) = \k{x)[(F{x),V^{x))X{x) - (F(x),X(x)}V^(x)), (2.47) 

where k(x) is the Gaussian curvature of M at the point x, and V x {x) is given by 

vi( X ) = {- (' v W- vxv * 

[H(x), ifX(x) = 0. 

Remark 2.1 Assume that M is a two dimensional Riemannian manifold. If X,Y G 
TM are orthonormal at some point x G M, then one has k(x) = sec(X(x), Y(x)). Ap¬ 
plying this relation and formula (2.30), one can easily check that (2.f7) is consistent with 
(2.31). 

Proof of Lemma 2.4 If X(x) = 0 or V{x) = 0, (2.47) holds obviously. 

If X(x) ^ 0, V{x) 7 ^ 0 and V x (x) / 0, set e\ = p^yy and e 2 = . Let us compute 

X ei (d x L x .F(x)e 2 ) firstly. Set ji(s) = exp x (sei) with s > 0 and i = 1,2. For any y G M 
closing enough to x, by the dehnition of the differential of a map, we have 

d x (L xy F(x))e 2 = d x (L xy F(x))i 2 (0) = ^ ^L^yF^is)). 

Using the definition of the covariant derivative in the sense of parallel translation (2.9) 
and the above identity, we see that 
V ei (d x (L x .F(x))e 2 ) 

= Y™ + \(^L llPr ) x d x (L xllPr) F{x))e 2 - d x (L xx F(x))e 2 ) 

= _ TS ^71 (t)x (-^ 72 ( 5)71 (t)-^ ? ( 72(' s )) — ^- l X 'y 1 ( T )F(x)j — ^L 72 ( s ) a ,F 1 (72(s)) ^ 

-F(x))^j 

H “+ 77 ( L 7!(r)^72(,)7 1 (T)^(72(«)) 7 J 'y2(s) X F (T2(®))^ 
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It is well known that the parallel translation of a vector along a curve conserves its norm 
and the angle between this vector and the curve. We will use this property to compute 


-^ / 7i(t)x-^ / 72(s)7i(t)-^( 72 ( s )) -L^ 2 ( s } x F■ 

Let j(-) be the shortest geodesic connecting 71 (r) and 72(5) with 7 ( 0 ) = 72 (s) and 7 ( 1 ) = 
71 (r). Denote by A ST the domain inside the geodesic triangle with vertexes 71 (r), 72(5) 
and x. The above formula represents the difference of parallel translations of ^(72(5)) 
along different curves. 

For s > 0 , denote by f3(s) the angle between F^is)) and 72(5). Then, the angle 
between L 12 ^ x F{^ 2 {s)) and 72(0) = e2 is /3 (s), while the angle between L 12 ^ x F{'y 2 {s)) 
and e\ is § — (3(s). Therefore, 

£ 72 ( 5 ) 0 ^( 72 («)) = |£( 7 2 (s))|(cos(| -P(s))ei +cos/3(s)e 2 ). (2.49) 

Denote the internal angles of the geodesic triangle A ST at the points 71 (r) and 72 ( 5 ) by 
and « 2 , respectively. The angle between ^( 72 ( 5 )) and 7 ( 0 ) is n — 07 — P(s), so is the 
angle between £ 72 ( 5)71 (t)-^^^)) and 7 ( 1 ). Then, the angle between £ 72 ( 5)71 (t)-^^^)) 
and 71 (r) is ir — 07 — 07 — /3(s). Thus, the angle between £ 71 ( r )x-£ 72 (s) 71 (r)£’( 72 ( 5 )) and 
71 (0) = e\ is 7 T — « 2~07 — /3(s). Consequently, the angle between £ 7l ( r )a;£ 72 (s) 7l ( T )£’( 72 (s)) 
and e 2 is 07 + 07 + /3(s) — due to the fact that e\ is perpendicular to e 2 - Therefore, 


£71 (t)xL^2 (5)71 (r) -£(72 (®) ) 

= |£’( 72 (s))|(cos( 7 t — a 1 — a 2 — P(s))e 1 + cos(ai + a 2 + /3(s) - §)e 2 ). 
The Gauss-Bonnet formula (ref. [11, p. 274]) gives 


OL\ + 0.2 



kdA+ 


(2.50) 


where cL4 is the Riemannian volume element. By using (2.49), (2.50), the above identity 
and Taylor’s theorem, we have 


£71 ( t ) o ! £72(5)71(1-) -£(72 ( s )) £72 (5)2 £ (72 ( s )) 

|£( 72 (s))|// kdA^cos/3(s)ei - sin/?(s)e 2 ) + o(f f kdA). 


(2.51) 


We choose {s, r} as the normal coordinates at the point x. When s and t are small 
enough, the area of A sr , denoted by 7l(A ST ), is given by 


A(A sr )= f (exp T 1 7 (-),ei )<% 
Jo s 
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Set v(s, t) = exp^ 71 (r). Then, 7 (C) = exp 72 (s) ((>(s, r)) with £ <E [0,1] and 


lim n+ 

S,T —^O” 1 ” 

= ^4™ l/o ( d exPx 1 

C ~= S iim fd (dexp- 1 I 


eX P72( s ) s' 1 




where we have used Lemma 2.1 and the L’Hopital’s rule. Recalling (2.48) and (2.51), we 
have 


^ e\ {d x L x .F (x)e 2 ) 


= s 53(2^7(l F (T2W)l// kdA^cos p(s) ei 

Ast 

= \k{x)\F(x )I ( cos/?(0)ei - cos (§ — /3(0)) e 2 ) 



— cos 


(f -0(s))e 2 ) +o(ff 

A S t 



which implies (2.47). 

If X / 0, L ^ 0 and Ry = 0, V is parallel to X. Similar to (2.48), we can get 
V ei (d x L x .F(x)ei) = 0, which implies V x{d x L x .F (x)V) = 0. The proof of Lemma 2.4 is 
complete. □ 


Remark 2.2 If X(x) = e\ and V ( x ) = e 2 are orthonormal, the left hand side of (2.31) 
characterizes the limiting case of parallel translations of vector field F along different 
curves. More precisely, by setting ji(s) = exp x (sei) with s > 0 and i = 1,2, we can get 
( 248 ). 


3 Statement of the main results 

We begin with the following assumptions (Actually, as we shall see later, for our Problem 
I, we only need the assumptions (Cl) and (C2) below): 

(Cl) The maps /(= f(t, x, «)) : [0, T] x M xl/4 TM and /°(= f°(t, x, u)) : [0, T] x M x 
U — > 1R are measurable in t, continuous in u, and C 1 in x. Moreover, there exists a 
constant L > 1 such that, 

\f°(s,xi,u) - f°(s,x 2 ,u )| < Lp(x i,x 2 ), 

I Lx 1 x 2 f(s,xi,u) - f(s,x 2 ,u )| < Lp(x i,x 2 ), (3.1) 

|/°(s, XQ, u)\ < L, \f(s,x 0 ,u)\< L, 
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for all s £ [0, T], u £ U, and xi,x 2 £ M with p(x 1 , 2 : 2 ) < min{i(xi),?'(x 2 )}, where 
xq £ M is arbitrarily fixed. 


{C 2) The maps f(t,x,u) and /°(f,x,tt) are C 2 in x. Furthermore, 


|V x /°(t,si , u ) L X2Xl V x f°(t,x 2 ,u)\ < Lp(xl,x 2 ), 

(3.2) 

, u) L x 2X\ V x f(t,x 2 ,u )| < Lp(xi,x 2 ), 

for all xi,x 2 £ M with p{x i,x 2 ) < min{i(xi), i(x 2 )} and (f,it) £ [0,T] x U, where 
V x f(s, •, u) and V x f°(s, •, u ) are the covariant derivatives of f(s, u ) and /°(s, •, u) 
with respect to the state variable, and their norms are given by (2.5). 


((73) U C JR m is open. The maps f(t,x,u) and f°(t,x,u ) are C 2 in u. Furthermore, 

|V„/°(t, x, m) - V n /°(t, x,u 2 )| < L\m -u 2 \, 


(3.3) 


|V n / (t, x, ui) - V n /(t,x,« 2 )| < L\m - u 2 1, 

for all ui,u 2 £ U and (t,x) £ [0, T] x M, where V u f(s,x, •) and V u f°(s,x, •) are the 
derivatives of f(s,x, •) and f°(s,x, •) with respect to the control variable. 

In this paper, for X £ TM (or X £ T*M ), we denote by X the dual covector (vector) 
of X. Denote by H v : [0, T] x T*M x U —> JR the Hamiltonian function, defined by 

H u (t, x,p, u ) = x, u)) + ^/°(t, x, u), V (■ t, x,p, u, v) £ [0, T] xT*M x UxM~, (3.4) 

with R~ = (—oo,0]. In particular, when u = —1, we denote by 

H = H~ l (3.5) 


for abbreviation. 

In this section, we fix a control u(-) £ U a( u where U a d is given in (1.3). Let y(-) be the 
solution to (1.1) associated to «(•). For abbreviation, we denote 

[t\ = (t,y(t),u(t)), Vt€[0,T]. (3.6) 

Suppose that ^(t) £ is the solution to the following first order dual equation 1 : 

f = -Vxf[t](il>(t),-) - vd x f°[t\, a.e. t £ [0, T), 

U(T)=^i 

with d x f° denoting the exterior derivative of /° with respect to the state variable x, and 
•) ('t £ [0, T]) being a tensor given by 

V x f[t](i/>(t),X(y(t))) = Vie TM. 

: Our first order dual equation (3.7) which contains the Levi-Civita connection V, is the same as the 
dual equation (12.30) in [1, p. 168], if they are rewritten in the local coordinates. Nevertheless, the explicit 
form (3.7) is convenient for us to derive further the second order necessary condition for optimal controls 
by introducing a suitable second order dual equation (i.e., (3.8) below). 
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3.1 Optimality conditions for systems without endpoint constraints 

Let ip(-) be the solution to (3.7) with v = — 1 and = 0. Recalling (3.5), we put 
U(t) = {ueU; H(t,y(t),i’(t),u(t.)) = H(t,y(t.),fi(t),u)}, t € [0,T], 

Let w(t) G 7$(y(t)) with t. G [0,T], and satisfy the following equation 
V-( 4 )ic + £ 12 (v x f[t] ®w(t)) + £ 12 (w(t ) ®'V x /[t]) 

' +^lH(t,y(t),i/}(t),u(t)) - = 0, tG[0,T), ( 3 - 8 ) 

. w(T) = 0, 

where £ 12 is defined in (2.16), the tensor R,(j;(t), •, f[t], is given by 

R(m,■,m, •) (x, y) = R(m,x,m, y ), vi,y e tm, 

and the tensor S7 2 H(t 1 y(t),'ip(t),u(t)) is given by 

x 2 x H(t,mmMmx,y) = y) - vifmx, y), vi,y 6 tm. 

Recalling the tensor contraction map in Section 2.4, we introduce two tensors 4>(t) G 
7if(y(t)) and 4 > i(t) G with t G [0,T], which solve the following equations respec¬ 

tively 


f Vg (t) $ = f 2i (v x /[t] ® m), t g (o,ri, 

1 $(0)(X, Y) = (X, Y), VI,YG T* q M, 

(3.9) 

f Vg (t) $! = -£ 12 ($i(t) ® V x /[t]), t G (0, T], 

\$ 1 (o)(x,y) = (x,y), vi,l g t vo m. 

(3.10) 


Our second order necessary conditions for optimal controls without endpoint con¬ 
straints are stated as follows. 

Theorem 3.1 Assume that the assumptions (Cl) and (C 2) hold, and ( U,d ) is a sep¬ 
arable metric space. Let ( y(-),u( •)) be an optimal pair for Problem I. Then, 

= max.H(t,y(t),ip(t),u), a.e. f G [0,T], (3.11) 

u€U 

where fi(-) is the solution to the first order dual equation (3.7) with v = — 1 and = 0. 

Furthermore, for any u(-) G U a d with u(t ) G U(t), a.e. t G [0, T\, it holds that 

fo T Jo - V x H(t,y(t),ip(t),u(t)), 

£ 21 (£ 21 (<b(f) (2) Lf^-^fis)) ® L$ )m (f(s,y(s),u(s )) - /[a]))} 

+i(w(t) + u;(t) T )(/(t,y(t),w(t)) - /[*],£ 21 (£ 21 ($(i) ® L S( a )y ( i) $ i( s ))® ( 3 - 12 ) 

LV y(s)y{t)(f( s ’y( s )’ u ( s )) ~ fi s ])))} dsdt 

< 0 , 
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where the 2-form w T (t) is the transpose of w(t), defined by w T (t)(X, V) = w(t)(V,X) for 
any X, V £ Ty^M, £ 21 is defined in (2.16), and the tensor V a -H(t,y(t),ip(t),u) (with 
u € U) is given by 

X x H(t, y(t),tf(t),u)(X) = V x f(t, y(t),u)(if>(t),X) - d x f°(t , y(t),u)(X), Vie TM. 

(3.13) 

Moreover, if U is a Polish space, then the following pointwise condition holds: 

\ (™(t) + ™ T (*)) (/W - f(t, f[t\ - f(t, y(t),v)^j 

+ (V x H(t,y(t),if{t),u{t)) - X x H(t,y(t),m,v)) (/[*] - f(t,y(t),v )) ( 3 - 14 ) 

<0, Vv€ U(t), a.e. t € [0,T]. 

Remark 3.1 The explicit dependence of the second order dual variable w(-) (involved 
in equation (3.8)) on the curvature tensor R(ip,-,f,-) reveals that the second order nec¬ 
essary condition (3.14) depends on the curvature. When M is lR n , the curvature is zero 
everywhere, and for this special case, Theorem 3.1 coincides with [26, Theorem 4-3]. 

Denote by ri(-, •) the Ekeland metric over the admissible control space U ad , given by 

d(u 1 (-),u 2 (-)) = |{i € [0,T];ui(t.) u 2 (t )}|, V u 2 (-) € U ad . 

It is well known that (11 a d ; d) is a complete metric space. 

Our second order sufficient condition for locally optimal controls for Problem I is 
given as follows: 

Theorem 3.2 Assume that (Cl) and (C 2) hold, and ( U,d ) is a separable metric space. 
If an admissible pair (y(-),u(-)) for Problem I satisfies (3.11), and there exist an e o > 0 
and a ft > 0 satisfying 

fo T Jo {(^xH(t,y(t),if(t),u(t)) - V x H(t,y(t),if(t),u(t)), 

£21 (^ 21 ($(*) ® ~ / M ))) 

+±(w(t) + w(t) T )(f(t,y{t),u(t)) - f[t],£ 21 (£ 21 ($(t) ® (3.15) 

L v(s)y(t)(f( s >y ( s )’ u (- s )) - /H)))}^ 

< -fid{u(-),u{-)) 2 , V u(-) € U ad with d(u(-),u(-)) < e 0 , 

then, one can find an e i > 0 such that 

J(v(-)) > J(u(-)), V v(-) e V = (u(-) € U ad ; d(u(-),u(-)) < ei}. 
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3.2 Optimality conditions for systems with endpoint constraints 


Before stating the main results of this subsection, we introduce some more notations. 
Recalling (3.4), under the assumptions (C2) and (C3), we introduce the following two 
tensors: 


V*iT(t, x,p, u)(X, Y ) = V 2 J(t, x, «)(p, X, y) + x , u)(X, F), (3.16) 

' VuV x H u (t,x,p,u)(X,rj ) = —(y x f(t,x,u)(p,X) + isd x f°(t,x,u)(X)^ -rj, (3.17) 

for all ( t,x,p,u,u ) £ [0, T] x T*M x U x M~ and X,Y £ TM and r/ € J? m . 

Assume that the condition (Cl) hold and (U. d ) is a separable metric space. If 
(y(-),'«(•)) is a optimal pair for Problem II, then there exist a u < 0 and a ipi £ T *v(T) M 
with \u\ + |-0i | > 0, such that the following Pontryagin’s type maximum principle holds 
([1, p. 181, Theorem 12.10]): 


H v (t,y(t),ip(t),u(t)) = max7P'(t,y(t),Y>(f),w), a.e.t £ [0,T], (3.18) 

u€U 


= 0, a.e.t £ [0,T], 

u(t) 


(3.19) 


where the covector field ip(-) along y{ ) solves (3.7). Moreover, when U C JR m is open, 
and / and f° are C 1 in u. it is easy to see that (3.18) implies that 

d_ 

du 

For any £(•) £ L 2 (0, T; JR m ), we denote by V(t) £ T.y^M (t £ [0, T]) the solution to the 
following first order variational equation: 

f v m V = V v(t)f( t r,u(t)) + V u f[t](-,£(t)), a.e.t £(0,T], 

\ V(0) = V(T) = 0. 1 ' 

Based on the above first order necessary condition, we give below a second order 
necessary condition for optimal pairs of Problem II. 


Theorem 3.3 Assume that the conditions (Cl), (C2) and (C3) hold, and (y(-),u(-)) 
is an optimal pair for Problem II. Assume that U C M m is open, u(-) £ L 2 (0, T; U), and 
for any neighborhood O of u(-) in L 2 (0, T\lR m ), there exists a v(-) £ V ac L FI O. If (u, iff) 
is a unique pair (up to a positive factor) satisfying (3.19), then the following second order 
necessary condition holds: 


(i) If v < 0 (the normal case), then 

fo T i/(t),$(t),u(t))(Z(t),{(t)) + V 2 x H u (t, y(t),if(t),u(t))(V(t), V(t)) 

+2V u V x H’'(t, y(t),m,h(t))(V(t),m) ~ V(t),g(t), V(t))}dt 

< 0 , 

(3.21) 

for all £(•) £ L 2 (0,T; M m ) and V(-) £ Ty^M satisfying (3.20), where the tensors 
V 2 FP and 'S7 U V X H V are given respectively by (3.16) and (3.17). 
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(ii) If u = 0 (the abnormal case), the left hand side of (3.21) is sign-definite on the 
following set: 

{?(•) € L 2 ( 0 ,T; lR m ); f 0 T {<V x f°[tJ, V(t)) + V u f°m(t))}dt = 0 , 

where P(-) G Ty(-)M solves (3.20)}. 

Remark 3.2 In optimal control theory, usually one may use the needle variation tech¬ 
nique to deduce a pointwise necessary condition from the integral one, provided that the 
later still holds when needle variations are used as control perturbations (e.g. the proof of 
[25, Theorem 1.6, pp. 150-158] for the first order case, and the proof of [26, Theorem 
4-3, p. 1455] for the second order case). However, in our case, (3.21) does not enjoy such 
a property, due to the hard restriction (3.20). Hence, it seems quite difficult to derive a 
pointwise condition from (3.21). 

Our second order sufficient conditions for locally optimal controls for Problem II is 
stated as follows: 


Theorem 3.4 Assume that the conditions (Cl), (C2) and (C 3) hold, U C lR m is 
open, and (y(-),u(-)) is an admissible pair for Problem II satisfying (3.18) for some 
v < 0 and ipi G T* M. If there exist a 70 > 0 such that 


du 2 


u(t) 


H v (t,y(t),if(t),u)(v,v) < - 70 M 


VuG M m , a.e. t G [0,T], 


and a 71 > 0 so that 


fo T {v(t), '*/’(*)> «(*))(£(*)»£(*)) + y(t),fi(t),u{t))(V (t), V(t)) 

+2 v u v x H"(t,m,m,u(t))(v(t),m)-R(kt),v(t),m,v(t))}dt ( 3 . 23 ) 

— — 7l||?ll|2( 0 ,T ; iR m )’ 


for all £ G L 2 (0,T; lR m ) and V(-) G Ty^M satisfying (3.20), then u(-) is locally optimal 
in the L 2 (0,T-,U) topology. 


4 Two illustrative examples 

In this section, we shall give two simple but illustrative examples to show the usefulness 
of our results in the last section. 

The first two lines of (3.1) and (3.2) are essentially Lipschitz conditions, and they are 
the key assumptions for our main results. The following result provides a method which 
can be employed to verify them. 
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Lemma 4.1 Let T be a tensor on M. Then, the following two conditions are equiva¬ 
lent: 

(i) There exists a positive constant L such that |VT| < L; 

(ii ) There exists a positive constant L such that \L XlX2 T{x \) — T(x 2 )! < Lp(x 1 ^x 2 ), for 

all X\,X 2 G M with p(x 1 , 0 : 2 ) < min{i(aq), i(x 2 )}- 


Proof: Suppose T G TM. Assume that ( i ) holds. Take any x\,X 2 G M with 

0 < p(x\,X 2 ) < min{?'(xi), i(.X 2 )}. Set V = p ( Xj \ X2 \ ex Px 2 Xl • Then, by Lemma 2.2, we 
have \V\ = 1. Assume that {ei, e 2 , • • •, e n } (with e\ = V) is an orthonormal basis at 
T X2 M. Set y(s) = exp X2 sV for s G [0, r] with r = p(x 1 , ^ 2 )- Then, 7 is the shortest 
geodesic connecting x\ and X 2 , and parameterized by the arc length. Let {d\, ■ ■ ■ ,d n } be 
the dual basis of {ei, • • •, e n } at X 2 ■ Set 


&i(s) L X2 ry^ s ^e-i, di(s) L X2l ^di, s G [0,t], i 1 ,***,77.. 


Then, {ei(s), • • • ,e n (s)} is the orthonormal basis at Ty( s ) M, {di (s), • • •, d n (s) } is the or¬ 
thonormal basis at T*^M for s G [0, r], and they are dual to each other. Thus, we can 
express T along the curve 7 as 

n 

T(j(s)) = J2 a i(s)ei(s), V s G [0, r]. 

i —1 


Take any v = v^d^ G T*M. By (i), (2.10), (2.7), the parallel translation of ej(-) and 


fc=i 


di(-) along 7 for i = 1, • • •, n and the Mean Value Theorem, one can get 

n n 

T(x 2 )(v) - L XlX2 T( Xl )(v) = |^aj(0)e;(^u fc <4) - T(x{) (L X2Xl v^j 


i— 1 


k =1 


i= 1 


= | - J2ai(T)ei(T)^J2v k d k (r)j\ = |^(a*(0) - a*(r)) 

i= 1 i= 1 k= 1 

n n n 

= T^diiQvi = p(xi,x 2 )^«*(C)ei(C)(5Z 

i= 1 i= 1 k =1 

= p{ Xl ,x 2 )y ^qT(l x 2 i{ 0 v) = p(xi, x 2 ) VT( 7 (C)) (l x 21 (qv, 7 
< L\v\p( Xl ,X 2 ), 


where ( G [0,1], and we get (ii). Conversely, if (ii) holds, we can apply (2.9) to get (i). 

When T is a tensor of general order, one can apply (2.7) and the same method as 
above to get the equivalence of (i) and (ii). □ 

By means of the above lemma, we give below an example which satisfies the assump¬ 
tions (Cl) and (C 2 ). 
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Example 4.1 Consider the hyperbolic surface under the hyperboloid model 


Hr = {(xi,x 2 ,x 3 ) £ Ft 3 ; x\ - (xf + xf) = R 2 ,x 3 > 0}, 


endowed with the metric h = Cm, where i : Hr —>• 1R 3 is the inclusion, m is the Minkowski 
metric m = dx 2 + dx\ — dx 2 , and h is the pullback metric. Hr is non-compact, and its 
Gaussian curvature is — 1. For the details of this model, we refer to [24, Proposition 3.5, 
p. 38]. Let (Hr,^>) be the local coordinates with 

4'(xi,x 2 ) = [xi ,x 2 ,\J R 2 + xf + xf), (xi,x 2 )g1R 2 . 


Let U = {1,2, 3,4} with the discrete metric. Denote 


f(x,u ) = u^e- [R 2 +x ^\x 2 4 - - f(x,u) = u 2 e HR 2 +A+A) 


d 


‘ dx\ 


dxo 


for x = (xi,x 2 ) £ Pi 2 and u £ U. We consider the optimal control problem (1.1) and (1.2) 
on Hr, with f and f° given above. Then, the conditions (Cl) and (C 2) are satisfied. 


Proof: It is easy to check that the third line of (3.1) hold. We will apply Lemma 4.1 
to check the first two inequalities of (3.1) and (3.2). By a direct computation, the metric 
h can be expressed in the local coordinates (,xi,x 2 ) by 

h = (l — ^- 7j)dx i <g> dx i - — 11X2 - 77 (dx i dx 2 + dx 2 <8> dx i)+ 

V R z + xf + xf' R 2 + xf + xi, 

2jdx 2 <8 dx 2 . 


( 


1 - 


4 

x 2 


R 2 + xf + x 2 - 


Hence, V/ and V 2 / in the coordinates x = (xi,x 2 ) £ R 2 are given respectively as follows: 


W x f(x,u) = u 3 e ( r2 + x \+ x D ((-2xix 2 - ®dx i + (-2x1 + 1 + ^)^ ® dx i 

+(2xf - - 1)^- ®dx i + (2 xix 2 + ® dx 2 ), (4.1) 

2 d 

V 2 /(x, u) = u 3 ^2 aiji(xi,x 2 )—®dxj ®dx t , (4.2) 


where a^xi,x 2 ) = e ~( R2 + x i + x 2 \R 2 + xf + x 2 )~ 1 p.iji(xi,x 2 ) with Piji(x i,x 2 ) being a 
polynomial of xi and x 2 for i,j , Z = 1,2. We also obtain that, for any tangent vector field 
Y = a 1 -JR + a 2g|^ and any cotangent vector held i] = b\d,x\ + b 2 dx 2 , 


\Y\<1 

H < 1 


if and only if 
if and only if 


Ul "1" O 2 — 


b\ + b 2 < 


R 2 + xf + x\ 

R 2 ! 

R 2 + xf + xf 
R 2 ’ 


(4.3) 
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where we have used the definition (2.5). Furthermore, for any x = (xi,x 2 ), by using (4.1) 
(4.2) and (4.3), we get 


\Vxf(x,u)\ E=sup{V a /(s,«)(77,y);»7 G TfM,Y G T X M,\Y\ < l,\v\ < 1} 


and 


= u 3 sup{e-^ 2+x i +a; i)(ai a 2 ) 


(- 


V 


2xi^ 2 jjs 2- — 2 x 2 + 1 + ^ 


max{a? + a|, b\ + b 2 2 } < R + X2 } 


x 2 

^ X l ~ "r2 ~ 2xiX 2 H J 

2 i i „,2 


bi 

M. 


i 


< L 


\V 2 J(x,u)\ = sup {v 2 x f(x,u)(r,,Y,Zy,r, G T*M,Y,Ze T X M, \rj\ < 1, |U| < 1, |Z| < l} 


= u 3 sup| aiji-^®dxj®dxi ^ (a k dx k ,b m -^—,c n -^-); 

i,j,i =i ' T ™ ' T " 


9 


/c,m,n=l 

.2 „2 .2 , .2 „2 , „ 2 ! / - R 2 + X 2 + X 2 


max {ay + a 2 , b( + b 2 , c{ + c 2 } < 


R 2 


} 


u 3 sup | ^2 a ijl a ibjCi] max{a{ + a 2 , 6 2 + b 2 , cf + c|} < 
i 


2 i ? 2 +xf 


R 2 


7 


< L 


for some positive constant L. By applying Lemma 4.1, we obtain the second inequalities 
of (3.1) and (3.2). Using the same way, one can get the first inequalities of (3.1) and (3.2). 
□ 

By means of Pontryagin-type maximum principle, Sussmann ([34, Example 5.10.2]) 
gave a new proof of the classical result that the locally shortest curve connecting two fixed 
points on a Riemannian manifold must be a geodesic. In the following example, we shall 
apply our second order necessary condition for optimal controls with endpoint constraints 
(Theorem 3.3) to recover the well-known second variation of energy: 


Example 4.2 Given any two points yo,yi G M, assume that y : [0,T] — >• M is a 
smooth curve with y( 0) = y$, y(T ) = y\ and constant speed \y(t.)\ = C > 0 (for all 
t G [0 ,T]). If y(-) is a locally shortest curve connecting yo and yi, then it must be a 
geodesic. Moreover, if y(-) is a geodesic, the following second variation of energy holds 
(see [31, p. 159]): 

J 0 T {r v m v \ 2 + R (y®’ vm))M), v(vm}dt > o (4.4) 

for any V G TM with V(yo) = 0 and V(y\) = 0. 
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Proof According to the completeness of ( M,g ), given any bounded domain D C M 
such that y(t) G D for all t G [0, T], one can find /i, • • •, f m G TM (m G IV) with compact 
supports, such that 


span{/i|^, • • •, / m fe} = (A^; A G TM}. (4.5) 


Indeed, by the completeness of ( M,g ) and the Hopf-Rinow Theorem (see [31, Theorem 
16, p. 137]), we see that D is compact. Hence, by [36, Lemma 1, p. 52] or [12, Theorem 
3.7, p. 72], there exist a <5 > 0 and ■ ■ ■ , xi G D (l G IN) such that, for all x G D, the 
map exp^, : B(0,6) C T X M —> B x (8) is diffeomorphic and u] :=1 .B Ti (e>/2) D D. Therefore, 
for each i = 1, • • •, l, we can define vector fields {//(-)}” =l on B Xi (S) as a basis for TM 
restricted to B Xi ( 5 ) as follows: 


fi(y) = rfexp 


,3 

—l '-'i ’ 
exp x y 


e-, Vy£B Xi (8), 


where {e|}” =1 is a basis at Xj. Then, we extend {//(')}?= i from B x .(5) to M smoothly, 


which are denoted by {/f}” =1 , such that // 


= f J 

n \B Xi (S/2) Jl 


B Xi (S/2) 


and /■ 


M\B Xi (6) 


= 0, for 


j = 1, • • •, n. Thus, {//} (i = 1, • • •, l, j = 1, • • •, n) can express linearly any vector held 
restricted to D. 

According to (4.5), we see that 


y(t) = TdLiMtffiivit)), a - e -t e [°> T ] ; 
2/(0) =yo, y(T) = yi, 


(4.6) 


with u(t) = (ui(t), ■ ■ ■, u m (t)) G M m a.e. t G [0, T], describes all absolutely continuous 
curves contained in D, with endpoints y$ and y\. In order to apply our optimal control 
results to the above shortest curve problem, we need to seek an appropriate cost functional. 
To this end, set 


f l = {y : [0, T] —> M; y( 0) = yo , y(T) = yi, and y(-) is absolutely continuous}. 

Denote by L(y) the length of y G D. [31, Proposition 17, p. 126] says that, if y(-) is a 
minimizer of L in ff, then it also minimizes E{y) = | f ’q \y(t)\ 2 dt within Q. Therefore, we 
dehne the cost functional as follows: 

rjn rj-[ YY], 

JH-)) = « / \Vu{t)\ 2 dt = - f \J2ui{t)fi{y u {t))\ 2 dt, (4.7) 

2 Jo 2 Jo 

where y u (") is the solution to (4.6) corresponding to the control u(-) G U = {u : [0, T] —> 
lR m : it(-) is measurable, and y u ( 0) = yo,y u (T) = Vi}- 

Hence, we choose (4.7) to be the desired cost functional. The corresponding Hamilto- 
nion function is 

m -i m 

H u (t, y,p, u) = p(52 u ifi(y)) + : (4-8) 

i =1 w i= 1 
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for (t,y,p,u,is) £ [0, T] x T*M x lR m x JR^. 

Suppose that (y(-), u(-)) is optimal for problem (4.6) and (1.6) with J given in (4.7). 
Then y(-) is the locally shortest curve connecting yo and y\. Applying Theorem 3.3 to 
this specific problem, we obtain that 


= _ max M*)(E™i + %\Y,iLiUifi{y(.t))\ 2 }, a.e.t £ [0,T], 


(4.9) 


where the first order dual variable ip solves 

E (t )^ = -Er=i ^(f)v/ t (y(f))(^(f), •) - ^ES=1 u ! (f)%(f)v/ ! (y(f))(/,(y(f)),•), 

a.e. t. £ [0, T], 

4’(T) = ip i, 

(4.10) 


with 


M + \ipi \ > o, v < o, 


(4.11) 


and fj (j = 1 , •••,m) being the dual covector of fj. Clearly, (4.9) is the first order 
necessary condition for (y(-),u(-)). 

By differentiating (4.9) with respect to the control variable at u(t) for almost every 
t £ [0, T], we have 


V>( t)(fi(y(t ))) + is{fi(y(t)),y(t)) = 0, a.e. t £ [0, T] (4.12) 


for i = 1, • • •, m. According to (4.5), for any V £ TM such that V (yo) = 0 and V(y\) = 0, 
we can find suitable real valued functions on [0, T]: £i(')> • • •,£ m (-), such that 


= 'Ztimw)), t e [o ,n 


(4.13) 


i— 1 


i =1 


Combining (4.12) and the above identity, we deduce that 


pT m m 

Jo i 1 1=1 


Using integration by parts to the above identity, via the dual equation (4.10), we can get 

T 

-v J o {v(y(t))^my) dt = o- ( 4 - 14 ) 

If i/ = 0, (4.12) implies ip(t) = 0 for all t £ [0,T], which contradicts (4.11). Hence, 
v < 0. By the choice of V. (4.14) implies V^^y = 0 for all t £ [0,T], which means that 
y(-) is a geodesic. 

From (4.12) we can get 

y(t) = ~ip(t), Vte[0,T], (4.15) 
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which implies {v,t]){) is unique up to a positive factor. In order to deduce the second order 
necessary condition, we need to compute V 2 7P, V U V X H V and V 2 x H v at (t, y(t),^j(t),u(t)) 
respectively. 

Recalling (4.8), for any 1 < i,j < n, we have 

~ 9 r, H u (t,y{t),^{t),u) = v(fi{y{t), fj(y(t)))), VfG[0,T]. (4.16) 

OUiOUj u(t) 

Hence, for any £ G L 2 (0, T;IR m ) satisfying (3.20) (or (4.13)), we get 

m 

VlH v (t,y(t),i(>(t),u(t))(Z(t),Z(t)) = ^\^2^i(t)fi(y(t))\ 2 . (4.17) 

2=1 

Recalling (3.16), (3.17) and (4.15), we obtain that, via the first order variational equation 
(4.13), 

y (t), V’(i), u(t))(v (■ t ), v (t)) 

= Kiwi 2 + \T,Zitimw))\ 2 - 2<Vg (t) v,££i Simw))))-, 

Inserting (4.17) and the above two identities into (3.21), and via (4.13), (4.15) and (3.20), 
we end up with 

0 < f 0 T {r v m vi 2 + R(m v(t),m vm+ 2<v v(t) ( e-u 
= f 0 T {r v m v \ 2 +R(m, v(t),m, vwjdt, 

which implies (4.4). □ 


Remark 4.1 The Legendre condition ([1, Theorem 20.6, p. 300 and Proposition 
20.11, p. 310]) says that the second order necessary condition of an optimal control u(-) 
is : 

d 2 - 

Jr -2 _H v {t,y{t),i]}{t),u){v,v) <0, VuG M m , a.e.t G [0,T], 

OU- u(t) 

Applying this condition to deal with the concrete problem in Example 4-2, instead of ( 4 - 4 ) > 
one can only get 

m 

v\^ v ifi(y{t))\ 2 < 0, Vu = (ui, • • • ,v m ) T G M m , (4.18) 

2=1 


a.e. t G [0,T], where (4-16) is used. Clearly, the condition (4-18) is trivially correct. 
Hence, our second order necessary condition in Theorem 3.3 provides more information 


than that in [1]. In addition, from the inequality (4-18), it follows that the optimal control is 


not totally singular, i.e. u(-) does not fulfills 


H u {t,y(t),if(t),u) = 0 a.e. t G [0,T], 


and therefore, the Goh condition and the generalized Legendre condition do not work. 
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5 Variations of Trajectories 


In this section, we shall give the first and second order variations of a trajectory of the 
control system (1.1), by employing respectively the needle variation in the case that the 
control set U is a metric space, and the classical variation in the case that U is an open 
subset in M m . 


5.1 Needle Variation 


In this subsection, we assume that U is a metric space. 


Proposition 5.1 Assume that the conditions (Cl) and (C2) hold. Fix any u(-) G 
U a d, and let y(-) be the corresponding solution to (1.1). For any u(-) € U a d, denote 
by X u (t),Y u (t) G Ty( t jM respectively solutions to the following first and second order 
variational equations: 

V m Xu = V.Y U (t)f(t,-,u(t)) + f(t,y(t),u(t)) - f[t ], a.e.t G (0,T], 

A'„(0) - 0. 

and 

' (V m Y u ,Z) = (Vy uW /(t,-,u(t)),Z) - ±R(Z,X u (t),f[t],X u (t)) 

+ ( V A' u (t)/(t, ■, u(t)) - V Xu( t)/(t, •, u(t)), Z) 
+lV 2 J[t](Z,X u (t),X u (t)), a.e. t. G (0, T], 

. y„(o) = 0, 

for any Z G TM, where [t] is given in (3.6). Then, as d(u(-),u(-)) = e —> 0, 

\X u (t)\ = O(e), \Y u (t)\ = 0(e 2 ), 

| V u (t) - X u (t )| = o(e), |K (t) - X u (t) - Y u (t)\ = o(e 2 ), 


(5.2) 


(5.3) 

(5.4) 


where 

V u (t) = exp“ ( ^ y u (t), t G [0,T], (5.5) 

and y u {-) is the corresponding solution to (1.1) with the control u(-). 

To prove Proposition 5.1, we need the following result. 

Lemma 5.1 Under the assumptions in Proposition 5.1, for any u{-) G U a d, it holds 
that 


p(yu(t), y u (t )) < (1 + p{x 0 , y 0 ))(e Lt - e Lt ), VO <t<t<T, (5.6) 


where xq G M and L > 0 are given in assumption (Cl). Furthermore, there exists a 
constant > 0 such that 


P(y(t),y u (t)) < 2L(1 + p(x 0 , yo))e Lt [0, t] n {r G [0, T\\u{t) ± u(r)} 
for any t G [0, T] and u(-) G U a d with d(u(-),u(-)) < e\. 


(5.7) 


31 



Proof: The proof is divided into two parts. 

Part I. In this part, we prove (5.6). Firstly, we claim that 

I f(t, y,v)\< l(p(x o, y) + l) (5.8) 

holds for any t £ [0, T], y £ M and v £ U. 

In fact, by the completeness of the manifold M, we can find the shortest geodesic 7 
connecting xq and y with 7(0) = xq and 7(1) = y. Let 0 = so < si < S 2 < ■ ■ ■ < Sjv-i < 
sn = 1 (for some N £ IV) be such that p( 7 (sj), 7 (sj-i)) < min{*( 7 (sj)),*( 7 ( 57 - 1 ))} for 
j = 1, 2, • • •, N. By means of (2.8), the condition (Cl), and the triangle inequality of the 
norm | • | yields 

\f(t,y,v)\ 

< l L 7 ( SJV - 1 )7(siv)/( t >7(siV-i),v) - f(t,y,v )| + \f(t,i(s N -i),v)\ 

< l L 7(^_i) 7 ( SJV )/( i >7(sA r -i)^) - f(t,y,v )| 

+\f{t,'j(s N -i),v) - L 7(sjv _ 2)7(sjv _ l) /(t, 7 (s JV - 2 ),u)| + |/(t,7(sjv-2),v)| 

< ... 

N 

< E |^7( Sj _i) 7 ( Si )/(i,7(sj-i)»v) - /(^7(si)>w)l + \f(t,x 0 ,v)\ 

3 =1 

< ^ E p(7(sj-i))7(sj)) + L = L(p{x 0 ,y ) + l), 

which implies (5.8). 

Secondly, we estimate |/(t, y u (t), u)| for any v G U and t £ [0, T]. Let (5 : [0,1] M 
be the shortest geodesic connecting y u (t) and yo and satisfy /3(0) = yo and /3(1) = y u (t). 
By the compactness, we can choose To = 0, r\, T 2 , • • •, r/ = 1 for some l £ IN, such that 
r 0 < ri < ••• < ti and p(/3(Ti),f3(T i+1 )) < min{z(/3(Tj)), i(/3(T i+ i)) for i = 0, ■ ■ ■, l - 1. 
Applying Lemma 2.2, the condition (Cl), (5.8), and the triangle inequality of the norm 
| • |, we obtain that 

\f(t,y u (t),v)\ 

< I f(t,y u (t),v) - L / 3( Ti _ l)/3(Ti) /(t,/3(7_i),u)| 

+\f {t-.fi{n-i),v) - L / 3( Ti _ 2 ) /3 ( Ti _ 1 )/(t,/3(T i _ 2 ),u)| H- £\f(t,y 0 ,v)\ 

<L E p(P(Ti),P(n-i)) + L(p(x 0 ,y 0 ) + 1) 

i= 1 

= Lp(y u (t),y 0 ) + Lp(x 0 , y 0 ) + L. 

Thirdly, we estimate p(y u {t),yo ) for any t £ [0, T]. Applying (5.9), we get 
p(yu{t),yo) < Jo \y u (s)\ds < L f* p(y u (s),yo)ds + Lt(p(y 0 ,x 0 ) + 1). 

Applying the Gronwall inequality, we obtain 

p(y u (t),yo) < (1 + p(x 0 ,y 0 ))(e Lt - 1), Vt £ [0,T], 


(5.10) 
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Finally, for any t,t £ [0, T] with t < t, applying (5.9) and (5.10), we have 
p{yu{t),y u (i)) < $1 |y u (s)|ds 

< Lft [p(y u (s),yo) + p(xo,yo) + 1 )ds 

< (1 + p(x 0 ,y 0 ))(e Lt - e Lt ), 

which yields (5.6). 

Part II. In this part, we prove (5.7). We will firstly show that (5.7) holds on a 
small interval, and then we extend it to the whole interval [0,T]. From (5.6), it follows 
that, for any u(-) £ U a d, the corresponding trajectory y u (-) is contained in the closed 
ball B yo (R ) with R = (1 + p(xo,yo))(e LT — 1), where B yo (R) is defined in (2.3).Clearly 
Byo(R) is compact, because of the completeness of the manifold M and the Hopf-Rinow 
Theorem (see [31, Theorem 16, p. 137]). Therefore, there exists a 5 > 0 such that, for any 
x £ B yo (R), the map exp^ : B(0, 6) C T X M —> B x (6) is diffeomorphic, due to [36, Lemma 
1, p. 52] or a direct consequence of [12, Theorem 3.7, p. 72], 

We claim that (5.7) holds on the interval [0, ti], where 

1 5 + 2(1 + p{x 0 ,y 0 )) 

t\ = — in-----——. 

L 2(1 + p(xo, yo)) 

In fact, by the triangle inequality of the norm | • | and (5.6), for any t £ [0,ti), we have 

p(yu(t),y(t )) < p(y u (t),y 0 ) + p(yo,y(t)) 

< 2(e Lt - 1)(1 + p(x 0l y 0 )) 

< 6 . 

Denote by I UJ Lu the indicator function of the set {r £ [0, T]; u(r) / H(t)}. For t £ [0,ti), 
using the condition (Cl), Lemma 2.2, (2.13), (2.6), (2.8), (5.6), (5.9), and (5.10), we get 

mP 2 (yu(t),y(t)) 

= (Vi p 2 (y u (t),y{t)),y u (t)) + (V 2 p 2 (y u (t),y{t)),y(t)} 

= - 2 (exp“ 1 (t) y(t), f(t, y u {t),u(t))) - 2(exp“ ( 1 t) y u (t), f[t ]) 

= -2(exp" 1 (t) y(t), f(t , y u (t),u(t))) - 2(exp~^ t) y(t ), f(t , y u (t),u(t)) - f(t , y u (t),u(t))) 
-2 (exp 2 ( t) y u (t),f[t]) 

= 2 ( ex P^(t) yu{t),L yu{mt) f(t,y u {t),u(t)) - f[t]) 

-2( ex p- 1 (t) y(t), f(t , y u {t),u(t)) - f(t, y u (t),u(t)))I u ^u(t) 

< 2 Lp(y(t),y u (t))(p(y(t),y u (t)) + 2e L * (1 + p(x 0 , yo))I u ?u(tj), 

which leads to 

^ -p(yu(t),y(t )) < L(p(y{t),y u (t)) + 2e Lt (l + p(x 0 ,y 0 ))I u ^u(t)y (5.11) 
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Applying Gronwall’s inequality to the above inequality, we get (5.7) on [0, t\). By the 
inequality (5.6) and the continuity of p(-,-), (5.7) actually holds on the closed interval 

[o,h]. 

Secondly, we show that (5.7) holds on the interval [0, £ 2 ] with 


t2 = i ln { 


0 Lt\ 


2(1 + p(x 0 ,yo)) 


(1 -Lei 


where 

ei = min { T, —- - - rT \. (5-12) 

I 'S(l + p{x Q ,yo))Le LT i 

We already showed that (5.7) holds on [0, Hj. It remains to show that, for u(-) € U ac t with 
d(u(-),u(-)) < ei, (5.7) still holds on [ti, ^ 2 ]- For this purpose, for any s € [ii,^ 2 )» applying 
(5.7) with t = t,\ and (5.6), we see that 


p{yu(s),y(s )) < p(y u (s), y u (ti)) + p(yu(h),y(h)) + p{y(h),y{s)) 

< 2(e Ls - e Ltl )(l + p(x 0 ,y 0 )) + 2L(1 + p(x 0 , y 0 ))e Ltl d(u(-), «(•)) 

< <5. 


Then, similarly to (5.11), by Gronwall’s inequality and (5.7) with t = t\, we can get (5.7) 
on [ii,£ 2 )- Furthermore, by the continuity of p 2 (-, •) and (5.6), one can easily get (5.7) on 
[0,f 2 ]- 

Using the same technique as above, one can prove by induction that (5.7) holds on 
[0, ti\ for i = 2 ,3,... with 


u = L ln ‘ 


2(1 + p(xo,y Q )) 


+ (1 - Le] 


(5.13) 


We claim that there exists an integer I > 0 being large enough such that [0, T] C [0, t,j]. 
Let us use the contradiction argument and assume that 


U < T. ViejOjUlV. (5.14) 

Then, there would exist a t > 0 and a subsequence of (still denoted by ), 

such that lim^+ooU = t. Letting 1 ->• +00 in (5.13) yields t = x In 2(i+ P {x S 0 ,y 0 ))Le 1 • 
Recalling (5.12), one has t>T, which contradicts (5.14). Hence we get (5.7) on [0,T], □ 

We are now in a position to prove Proposition 5.1. 

Proof of Proposition 5.1 First, we will prove (5.3). Multiplying both sides of (5.1) 
by X u (t). using (Cl) and Lemma 4.1, we get 

\\X u {t)\-§- t \X u (t)\ 

= V x f[t](X u (t),X u (t)) + C f(t,y(t),u(t )) - f[t],X u (t)) 

< L\X u (t)\ 2 + | f(t,y(t),u(t)) - f[t\\\X u (t)\, 
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which leads to 


\X u {t)\<2L j \X u (s)\ds + 2 f \f(s,y(s),u(s)) - f[s]\ds. 

Jo Jo 

Applying Gronwall’s inequality to the above inequality, we can get, via (C 1), the first 
estimate in (5.3). 

To prove the second estimate in (5.3), we take Z = Y U in (5.2), and get 

5l^WI|l y n(t)| = v x /[t](y n (t),y n (t)) + v a; (/(t,y(t),u(t))-/[t])(y u (t),x n (t)) 
-\R(Y u (t), X u (t), f[t},X u (t )) + \Vlf[t}(Y u {t),X u {t),X u (t)). 

Applying (Cl), (C2), Lemma 4.1 and the first relation of (5.3), we can find a positive 
constant C > 0 such that 

§- t \Y u (t) | < C(\Y u (t)\ + \X x f(t,y(t),u(t)) — X x f[t]\\X u (t)\ + 0(e 2 )). 

Integrating the above inequality on [0, t], by Gronwall’s inequality, and applying the first 
estimate in (5.3), the condition (C2) and Lemma 4.1, we obtain the second estimate in 
(5.3). 

Next, we are going to prove (5.4). 

By Lemma 5.1, there exists an eo > 0 such that, for all u(-) £ U a d with d{u(-),u{-)) = 
e < eo, we have p(y u (t),y(t)) < i(y{t)) for all t £ [0, T]. Then, we can define V u (-) as in 
(5.5). For f € [0,T], let V u (t ) be a vector at Ty^M satisfying 

v u) = f mtjkw Vu ^’ lf \ Vu ^\ ^ 0; 
l o, if| 14 (f)| = 0. 

Then, we define a geodesic connecting y(t ) and y u (t ) as follows: 

/3(0-,t) = exp 5(t) ev u (t), 9 £ [0 , p(y(t),y u (t))\. 

The inequality (5.7) indicates that /?(•; t) is the shortest geodesic connecting y(t) and y u (t), 
provided d(u(-),u(-)) = e is small enough. In particular, in the case that |14(t)| / 0, (3(-]t) 
is parameterized by the arc length. For any Z £ TM, applying Lemma 2.2, Lemma 5.1 


(5.15) 


(5.16) 
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and Taylor’s expansion, we get 
(V m V u ,Z) 

= -±X7 2 Vip 2 (y(t),y u {t)) ( Z, /(f, y u (t),u(t ))) + ^V 2 Vip 2 (y(f), y(f)) (Z, f(t, y(t),u(t ))) 
- 3 Vfp 2 (y(f),y„(f))(Z,/[f]) + ^V 2 1 p 2 (y(t),y(t))(Z, f[t}) + (Z, f(t,y{t),u(t)) - f[t ]) 

= -^Mle=oV 2 Vi p 2 (y{t),/3(9- 1)) (z, f(t,/3{9 ; f), u(f))) p(y(t),y u (t)) 

- 2 ^|e= 0 V 2 Vi p 2 (y(t),(3(0; f))(z, f(t , /3(0; f), u(f))) P 2 (y{t),yu(t)) 
-^\e=o^ip 2 (y(t), P{0;t))(zj[t}^ p{y(t.),y u (t.)) + (Z, f{t,y(t),u(t)) - f[t ]) 
-i^|e=oVi/? 2 (y(t), /?(#; f)) (z, f[tfjp 2 (y(t),y u (t)) + o(e 2 ) 

= ( z > Vy„( t )/(f,-,u(f))) + < ZJ(t,y{t),u(t )) - /[t]) + (Z, Vv u(t) /(t,-,u(t)) 

-Vv -W /(t, ■,«(*))) - |ViVip 2 (y(t), y(t)) (z,/(i, y(t),u(t)), 14(f), 14(f)) 
-lv 2 v 2 lP 2 m,m)(zj[t],v u (t),v u (t)) 

+\{ z , Vv„(t) «(f))|0=o)p(s/(f)> j/«(f)) + o(e 2 ). 

By Lemma 2.3, we obtain 

(V m V v ,Z) 

= ( Z 1 Vy u(t )/(i, •, ti(f))> + ( z , f(t, y(t),u(t)) - f[t ]) + (Z, Vy u(t) /(f, •,«(*)) 
-V Vu{t )f(t,-Mm ~ lR(f[t],V u (t),Z,V u (t)) (5.17) 

+ i(Z, V y i ( t )V^ /3(e;t) /(i,-,M(t))|0 = o)p(y(t),y u (t)) 

-lV 2 Vi p 2 {y{t),y{t))[zj{t,y{t),u{t)) - /[f], 14(f), 14(f)) +o(e 2 ). 

We observe that, for any v € 17, 

{ z , v Vu(t) v |^(0 ; t)/(4 •, v)| e=0 )p(y(t), y u (f)) = V 2 /(f, y(t),v)(Z , 14(f), 14(f))- (5.18) 

In fact, recalling the definition of 14(f), (2.11), (2.10) and (5.16), we have 
The left hand side of (5.18) 

= V u (t,)(\7 -, v), Z)p(y u (t), y(t)) - (Vy u{t) f(t, -, v), V Vu(t) Z}p(y u (t),y(t)) 

= v u (t) (v x f(t, -, v)(Z, ^/3(0; t)j^p(y u (t),y(t)) - V a /(f, y(t),v)(V Vu{t )Z, 14(f)) 

= ( v Vu(t)(VaJ(f, -,«))) (-4 -§e/3{0-, t)\e=o)p(yu(t),y(t)) 

= V 2 /(f,y(t),n)(Z,K(f),K(f)), 

which implies (5.18). Inserting (5.18) into (5.17), and subtracting (5.1) from (5.17), we 
get that 

' (Vg (t) (K --X«),^) = ( z ,^Vn(t)-X u (t)f(t,;u(t))) - ^(/[f], 14(f), Z, 14(f)) 
+V*(/(f, y(f),«(f)) - /[f]) (Z, 14(f)) + ^V 2 /[f](Z, 14(f), 14(f)) 

’ — i^’IV ip 2 (y(t),y(t)) ^Z, f (f, y(t),u(t)) - /[f], 14(f), 14(f)) ( 5 - 19 ) 

+| V z(/(f,2/(f),«(f)) - /[f])(Z, K(f), K(f)) + o(e 2 ), f € (0, T], 

. 14 ( 0 ) - X u (0) = 0. 
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Taking Z = V u (t) — X u (t) in the above system, and using (C 2), (C3), (5.3) and Lemma 
2.2, we can find a positive constant C > 0 such that 

§- t \V u (t) - X. u (t) I 2 < C\V u (t) - X u (t) I 2 + CI { ^ u} (t)\V u (t )\ 2 + o(e 2 ), 

where is the indicator function of the set {r € [0,T]; u(r) / u(r)}, and the 

boundness of curvature tensor R along y(-) is used. By integrating the above inequality 
over [0, t], applying Gronwall’s inequality of integral form and (5.3), we can get the first 
estimate in (5.4). 

We subtract (5.2) from (5.19), and get 

i^V(t)( v u “ X u - Y U ),Z) = (Z, Vvi(t)-x„(t)-y„(t)/(V,«W)) 

+v x (/(t, £(*),«(*)) - /[*]) (s, v u {t) - x u (t)) 

-±R(Z,V u (t)-X u (t),f[t],X u (t)) - \R(f[t],V u (t) -X u (t),Z,V u (t)) 
+±v 2 /[t](z, K(t) - X u (t), v u (t)) + ±v 2 /[t](z, v u (i), K(t) - *„(*)) 

-iV^Vip 2 (y(t), y{t))(z, f(t, y(t),u(t )) - /[t], K(i), K(0) 
+iV 2 (/(t,y(t),u(i)) - f[t])(Z,V u (t),V u (t)) +o(e 2 ), t € (0,T], 
I4(0)-V n (0)-Y n (0) = 0, 

which implies 

\X m (V u -X u -Y u )\ 

< C\V u (t ) - V u (t) - Y u (t)| + C/ { ^ } (t)(|K(t) - V„(t)| + \V u (t)\ 2 ) 

+C\v u (t ) - X u (t)|(|KWI + |*«(*)l) + o(e 2 ), 

where we have used (Cl), (C2), Lemma 4.1, the boundness of curvature tensor R along 
y(-). Moreover, by applying (5.3), the first estimate in (5.4), Lemma 5.1 and (2.17), we 
can get 

11 V u (t)-X u (t)-Y u (t)\ 2 

< 2\X m (V u -X u - Y u )\\V u (t) - X u (t) - Y u {t )| 

< C\V u (t) - X u (t) - Y u (t) I 2 + C\V u (t) - X u (t) - Y u (t)\\V u (t) - X u (t)\(\Vu(t)\ + \x u (t)\) 
+CI {u ^u}(t)(\V u (t) - X u {t) I + \V u (t)\ 2 )\V u (t) - X u (t) - Y u (t) I 
+o(e 2 )|14(f)-X u (f)-Y tt (t)| 

< C'lK(t) - *„(*) - Y u (t)| 2 + C/ {u ^ } (t)(|Y u (t)| 2 + 114(t)| 4 ) + o(6 4 ). 

By integrating the above inequality over [0, t] and applying Gronwall’s inequality and (5.3), 
we can get the second estimate in (5.4). □ 

5.2 Classical Variation 

In this subsection, we assume that U is an open subset in M m . Similarly to Proposition 
5.1, we have the following simple result. 
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Proposition 5.2 Assume that the conditions (Cl), (C2) and (C3) hold. For any 
u(-) G L 2 { 0, T; C) and v(-) G C 2 (0, T; f? m ), set 

it e (-) = u(-) + «;(•), e > 0. 

Denote byy e (-) the solution to (1.1) with control u e (•). In particular, we denote byy(-) the 
solution to (1.1) with control u(-). For any e > 0 being small enough, we define a vector 
field along y(-) as follows: 

V e (t) = expl^ y € (t), t. G [0 ,T]. (5.20) 

Let V{-) and Y(-) be respectively the vector fields along y(-) solving: 

I V m V(Z)=V x f[t](Z,V(t)) + V u f[t}(Z,v(t)), a.e. t G (0, T], VZeT*M, 

1 no) = 0, 

and 

(v^ (t) y(z) = v*/[t](z,y(t)) + v*v u /[t](z,u(t),n*)) - ±i2(z,y(t),£(t),n*)) 

j +iV 2 /[t](Z,P(t),P(t)) + ±V 2 /[f](Z,u(f)Xf)), a.e.t G (0,T],V Z G T*M, 

l y(o) = o. 

(5.22) 

Then, we have 

V e (t) = eV(t) + e 2 Y(t) + o(e 2 ), VfG[0,T]. (5.23) 


Proof Similarly to Lemma 5.1, when e > 0 is small enough, p(y e (t),y(t)) = O(e) for 
any t G [0,T]. Thus, one can define the vector held (5.20). 

Following a similar argument as that in the proof of (5.17), we can obtain, for any 
Z € Ty^M, 


(v m v e , z ) 

= V x flt](Z,Vfit)) + V u f(t}(Z,v(t))e + V x V u f[t}(Z,v(t),Vfit))e-±R(Z,Vfit),m,V e (t)) 
+\V 2 x f[t](Z,V e (t),V e (t)) + \V 2 J[t](Z,v(t),v(t))e 2 +o(e 2 ). 


Dividing the above identity by e, we obtain that 

lim = V(t) (5.24) 

e-> 0 + e 

uniformly in t G [0, T\, where V(-) is the solution to (5.21). 

Similarly, one can check that 


lim 

e—>0+ 


V e (t) - eV(t) 


Y(t) 


uniformly in t G [0, T], where Y(-) is a vector held along y(-) solving (5.22). Thus, the 
proof is concluded. □ 
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6 Proof of the Main Results 

This section is addressed to proving our main results, i.e., Theorems 3.1-3.4. 


6.1 Proof of Theorem 3.1 

The proof of Pontryagin-type maximum principle (3.11) is given in [1, p. 183, Theorem 
12.13]. This subsection aims at proving the second order necessary condition. We divide 
the proof into 3 steps. 

Step 1 In this step, we will give the second order expansion of «/(•) around the optimal 
control u(-). Fix any u(-) £ U a d and e > 0. Define 

u e (t) = u(t)I[ 0>T \\ Ee (t) + u(t)I Ee {t), (6.1) 

where E e C [0, T] is a measurable subset of [0,T] with \E e \ = e. Let y e (-) be the solution 
to (1.1) corresponding to the control u € (-). Denote by X e (-) and Y e (-) the solutions to 
(5.1) and (5.2) with u(-) = u e (-), respectively. By Proposition 5.1, there exists an eo > 0 
such that, for all e < eo, we can define 

V e (t.) = expl^ y e (t), V t £ [0, T], 

and 


X e (t) = 0(e), W(t) = 0(e 2 ), V £ (t) = X\t) + Y%t) + o(e 2 ), Vte[0,T]. 

Similar to (5.15) and (5.16), for t £ [0, T], let V € (t) be a vector at y(t) satisfying 

\o, if|V‘(t)|= 0 , 

and let 7 (-;f) be the shortest geodesic connecting y(t) and y e (t), given by 


( 6 . 2 ) 


(6.3) 


7 ( 0 ; t) = exp y(t){0V e (t)), 

In particular, in the case that |P e (t)| / 0, 
Recalling (3.6), and applying (2.4), Tayor’s 


0 e [o,p{y(t),y € {t))\. (6.4) 

7 (•;£) is parameterized by the arc length. 
Theorem, Lemma 5.1, (6.3) and (6.4), we 
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obtain that 


■/(«*(•)) - AH-)) 

= fo T (f°( t >y e ( t )’ ue ( t )) ~ f°Ay(t)> ue (t)) + f°{t,y{t),u e (t)) - f°[t])dt 
= fo (/°(*»7 (p(y(t),y e (t));t),u e (t)) - /°(t,7(0;t),« e (t)) 
+f°{t,y(t),u e (t)) - f°[t])dt 


= fo (Jk 0 /°(^7 (s;t),u e (t))p(y(t),y e (t)) + 7 ( 5 ; t), u e (t))p 2 (y(t), y e {t)) 

+f°{t,y(t),u e {t)) - f°[t] + o(p 2 (y{t),y € {t))^dt 
= fo ({^xf°{t,y{t),u e (t)),V e (t))p(y(t),y e (t)) 


+h^xf (*, y(t),u € (t))(V e (t), V e (t))p 2 (y(t),y e (t)) + /°(t, y{t),u e (t )) 
-/°M + o(p 2 (y(t),y e (t))))dt 

= fo ((Vxf°[t],V‘(t)) + fr 2 x f°[t]{V*{t),V*{t)) + f°{t,y{t),u*{t)) - f°[t} 
(/°(i, y(t),u € (t .)) - /°(i, y(t),u(t ))) (U e (t), U e (t)) 

+ (V x /°(f, y(t),u e (t)) - V x /°[t], U e (f)) + o{p 2 (y(t),y e (t)))) dt. 


Recalling (5.7) and (6.2), we further get 


J(n e (-)) - J(«(-)) = 7i + / 2 + o(e 2 ), 


(6.5) 


where 

h = £ ((V x f°[t\,X*(t)) + f°(t, y(t),u e (t)) - f°[t])dt , (6.6) 

h = £ ((V x f°[t],Y^t)) + (V x f°(t,y(t),u*(t)) - V x f°[t],X e (t)} 

+ l -Vlf\t}{X\t),X\t)))dt. (6.7) 

In what follows, we will rewrite I\ and / 2 by the dual variables and the perturbed 
control u e (-). Recalling the first order variational equation (5.1), the first order dual 
equation (3.7) and (3.4) with v = — 1 and ip\ = 0, we have, via integration by parts over 

[0 ,T], 

h = fo (Vij(t)A xe (t)) + Vx«(t)/(*>•.“WXV’W) + f°(t, y(t),u e (t)) - f°[tfjdt 
= fo m*)f - ^m xe + '>«(*))) +/°(i,y(i),w e (t)) -/°[t])df 

= So m*)(/[*] - f(t,y(t),u e (t))') + f°{t,y(t),u e (t)) - f°[t]jdt 
= / 0 T - H(t,y(t),ij>(t),u e (t))')dt. 

Using (3.7) with zv = — 1 and V’l = 0, the second order dual equation (3.8), the second 
order variational equation (5.2) and integration by parts over [0,T], via (3.13) and (3.16), 
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we can get 

h = / 0 T (Vj (t) ^(F € (t)) +^(t)(Vy« (t) /(t,-,«(())) + (V*/°(f,y(t),u e (f)) 
-V*/°[t], **(*)> + iV|/°[t](A: e (t),X e (i)))di 
= Io (m(~ Vg (t) ^ e + Vy« (t) /(i,-,«(*))) + <V x /°(t, */(*)> «'(*)) 
-v*/°[t],x e (i)) + ±V 2 J°[f](^(f),^(t)))dt 

4 v 2/[*M*),* e (*),* e (*)) + (V x f°(t,y(t),u e (t)) - V x f°[t],X e (t)) 
+\vmt]{x\t),x^t)))dt 

= -^3 + ^ 4 ) 


where ip is the dual vector of ip, 

h = \ f 0 T (R$(t),X e (t), f[t],X e (t)) - V 2 id(f, ^(t), u(t))(X*(t), X*(t)))dt, (6.10) 
and 

h = f (V x H(t, y(t),ip(t),u(t)) - V x H(t , y(t),ip(t),u e (t)),X e (t))dt. (6.11) 

Jo 

Next, we shall re-write I 3 and I 4 in terms of local coordinates along y(-). For this 
purpose, let {ei, e 2 , ■ ■ ■, e n } be an orthonormal basis at y(0 ) = yo, and {di, g? 2 , • • ■, d n } be 
the dual basis of {ei, e<i, ■ ■ ■, e n }. For t G [0,T], we define 

e*W = L St) e *’ di ^ = L lom di ’ i = (6.12) 

By (2.6) and (2.7), we have 

( e i(t),ej(t)) = di(t)(ej(t)) = 6 j, i,j = l,2,---,n, £G[0,T]. (6.13) 

Set 

n 

X*(t) = '£x*(t)e i (t), X\t) = (X{(t),...,X* n (t)) T . (6.14) 

i= 1 

Inserting the above equalities into (6.10), we get 

J 3 = ltr/ 0 T (M(t) - H{t))X e {t)X eT (t,)dt, (6.15) 

where 

M(t) = ( M ik (t )) = (^R(ip(t),ei(t),f[t],ek{t))y t G [0,T], (6.16) 

H(t) = (. H ik (t )) = (v^(t,y(t),V’(t),«(t))(e i (t),e fc (t))), t G [0,T], (6.17) 

Let us derive the differential equation satisfied by the matrix X e (t)X' eT (t). Inserting 
(6.14) into (5.1), via the parallel translation of ej(-) [i = 1, • • • ,n) along y(-), we can get 

f X e (f) = F{t)X e (t) + Fi(t,u £ (t)), t G (0, T], ( 61g ) 

lx e (o) = o, 
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where 


F(t) = (Jv ej ( t )f(t,-,u(t)),ei(t)y) = V x f[t](di(t),ej(t )) = (^(t)), (6.19) 


if(t,y(t),u) - f[t\, e\{t)) 


Fi(t,u) = 




( 6 . 20 ) 


\(f(t,y(t),u ) - f[t\,e n (t))J 
Hence, we get the equation for X e (t)X eT (t) as follows: 

j t (X e X eT )(t) = F(t)(X e X eT )(t) + (X f 'X eT )(t)F(t) T + Fi(t,u e (t))X e (t) T 
' +X'(t)F 1 (t,u e (t)) r , t G (0, T], 

, ( X € X eT )(0 ) = 0. 


( 6 . 21 ) 


We now derive the local form of the second order dual equation (3.8). Recalling (6.13), 
we can express the solution w to (3.8) by 


w(t) = ^2 mj(t)di(t) <g> dj(t), 
i,j=1 


( 6 . 22 ) 


where Wij(t ) = w(t)(ei(t), ej(t)) for any t € [0, T]. The transpose of w(t) can be rewritten 


w T (t) = ^2 Wji(t)di(t ) <g> dj(t), V t € [0, T]. 


(6.23) 


Recalling (6.19), we have 


v,/[t] = E Fij{t)ei(t ) <g> dj(t). 
*,i=i 


Thanks to (6.16) and (6.17), we have 


(6.24) 


= J2 M ij (t)d i (t)®d j (t), 
i,j=1 

n 

V 2 x H(t,y(t),ip{t),u(t)) = J2 H ij (t)d i (t)®d j (t). 

i,j=l 


(6.25) 


(6.26) 


W(t) = V t € [0,T], 


(6.27) 


Recalling (6.12) and (6.13), we insert (6.22), (6.24), (6.25) and (6.26) into (3.8), and get 


W(t) + F{t) T W(t ) + W(t)F(t) - M(t) + H(t) = 0, t € [0, T), 
W(T) = 0. 


(6.28) 
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Applying (6.21), (6.28) to (6.15), via integration by parts over [0, T\, we get 


h 

= |tr/ 0 T (W(t) + F{t) T W(t) + W(t)F(t,))x e (t)X eT {t)dt 
= ¥rfo W)( - |(X^ T )(i) + F{t){X'X* T )(tj) +F(t)- r W(t)(X^ T )(t)}dt 
= ±fr/ 0 T { - W{t)(X-X^)(t)F{ty - W^F^tXit))^(t) - W(t)X^t)F l (t,u^{t)) T 
+F(t) T W{t)X e (t)X eT {t)}dt 
= -\tr / 0 r (W(t) + W T {t))F 1 (t , rA(f))A eT (f)cit 
= -kfo {(W(t) + W T (t))F 1 (t,u%t)) ■ X%t)dt, 

(6.29) 

where we have used the properties: tr(AB) = tr(BA) and trA = tr(A T ) for any n x n 
matrixes A and B. 

In order to express I 4 in the local form, for any u € U and i = 1, ■ ■ • ,n, set 

5diH(t,u ) = (v x H{t,y(t),ip(t),u{t)) - V x H(t, y(t), ip(t), it)) (e*(t)), (6.30) 

8 dH(t, u) = (8d\H{t, u), ■ ■ ■ , Sd n H(t, u)j . (6.31) 

Recalling (6.14), we have 

/ 4 = f T 58H(t , u e (f)) • X e (f)cit. (6.32) 

Jo 

Now, we re-write X e in terms of ■u e (-). Assume that $(•) = ( 4>ij{ •)) is an ]R nxn -valued 
function satisfying 

U(t) = F(t)$(t), t e (0,31, (6 33) 

U(0) = /, 

where / € M nxn is the n x n identity matrix. Recalling (6.18), we have 

X e (f) = ^ ^(t)^- 1 {s)F 1 (s,u e {s))ds, (6.34) 

Jo 

where 4 >_1 (-) = (ipij(-)) is the inverse of <&(•). 

Inserting (6.29) and (6.32) into (6.9) via (6.34), and recalling (6.1), ( 6 . 8 ), (6.20), (6.30) 
and (6.31), we can rewrite (6.5) by 

J(u e (-)) ~ 

= f Ee - H(t,y(t),'ip(t),u(t))')dt + f Ee | - \{W(t) (6.35) 

+W T (t.))Fi(t, u(t)) + 6dH(t , rt(f)) j • $(i) /q 4> _ 1 (s)Fi(s, u € (s))dsdt + o(e 2 ). 

Step 2 In order to get the integral form of second order necessary condition, we apply 
[25, Corollary 3.8, p. 144] to choose suitable measurable set E e in (6.35). Let u(-) be such 
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that u(t) £ U(t), a.e. t £ [0,T]. Let E e C [0,T] with \E e \ = e be such that 
/[o,t]ni? e ^ _1 ( s ) F i( s > u ( s )) ds = e /o \s)F 1 (s,u(s))ds + ij 1 (t ), 

I[o,t]nE e { - \{ w i T ) +W t (t))F 1 (t,u{t)) 

+5dH(T,u(r))^ ■ $(r) / 0 r l> _1 (s)Fi(s, u{s))dsdr 
= e/o { - + W t (t))F 1 (t,u(t)) 

+5dH(T,u(r ))| • ®(r)f 0 r ^~ 1 (s)F 1 (s, u(s))dsdr + ?? 2 (i), 

where 

\rii(t)\<e 3 , Vt <E [0,T], i = 1,2. 

Then, dividing (6.35) by e 2 and taking the limit as e —>• 0, one can get, via the optimality 
of u(-), 

0 </ { - ^(W(i) + IF T (f))Fi(f, u(f)) + (59iL(t,u(t))| • l>(t) J ^~ 1 (s)Fi(s,u(s))dsdt. 

(6.36) 

Set 

n n 

= E <t>ij(t)ei(t) <g> ej(t) f ®i(t) = Y, ipg(t)di(t) (8> dj(t), <G [0,T], (6.37) 

i,j =i *d=i 

Recalling (2.16), (6.24) and (6.33), one can check, via (6.12) and (2.7), that $(•) and 4 > i(-) 
solve (3.9) and (3.10) respectively. 

Recalling (6.20), (6.22), (6.23), (6.27), (6.30), (6.31) and (6.37), one can get (3.12) 
from (6.36), via (6.12) and (6.13). 

Step 3 In this step, we shall get the pointwise form of the second order necessary 
condition. Assume that U is a Polish space. Recalling (6.36), define 

Gi(t,u) = $(t) T { - \{W(t) + W T (t))F 1 (t,u) + SdH(t, it)}, 

G 2 (t,u ) = $ _1 (t)Fi(t, u), (t,u) £ [0, T] x U. 


(6.38) 


Then, by (6.36), for any u(-) £ U a d and u(t) £ U(t ), a.e. t £ [0,T], one has 


0 < f Gi(t,u(t)) ■ [ G 2 (s,u(s))dsdt. 
Jo Jo 


(6.39) 


Applying the same argument as that in the proof of [26, Theorem 4.3], we can get, 
from the above inequality and the conditions (Cl) and (C2), 

Gi(t, u(t)) ■ G 2 (t, u(t)) > 0 a.e. t £ [0, T\. 

Following the same argument as that in the proof of [26, Theorem 4.3] again, we can get, 
from the above inequality and the assumption that U is a Polish space, 


Gi(t,v) ■ G 2 (t,v) > 0 \/v£U(t), 
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for a.e. t £ [0, T]. Recalling (6.38), the above inequality implies 

0 < { - 7 >(w(t) + W T (t)^jF 1 (t,v) + 5dH{t,v)} \/v £ U(t), a.e.t £ [0,T], 

(6.40) 

Combining the above inequality with (6.13), (6.20), (6.22), (6.23), (6.30) and (6.31), we 
can easily obtain (3.14). □ 

6.2 Proof of Theorem 3.2 

For any vf) £ U ac L with d(u(-),v(-)) = e being small enough, from (6.35), we have, 

= fo T (- H '(*.y(*))V’(*)»'“(*)) - H(t,y(t),ip(t),v(t))^dt + / 0 T [ - + W T {t)) 

Fi(t,v(t)) + 5dH(t, u(t))| • <l(f) Jo 4> ~ 1 (s)Fi(s,v(s))dsdt + o(e 2 ). 

Recalling (6.20), (6.22), (6.23), (6.27), (6.30), (6.31) and (6.37), one can get, via (6.12) 
and (6.13), 

J(u(-)) - 

= fo T ( H(t,y{t),i/>(t),ii(t )) - H(t, y(t),f>(t),v(t))^j dt — / 0 T {^(w(t) + w T {t)) 

- f[t],£ 21 (£ 21 ($(t) ®^J( s ) ff(t) ^i(a))® 

-V x H(t, y{t),ip(t),u{t)),£ 21 (£ 21 ($(t) (8) R|{ s L {t) ^i(s)) <g> L y - { ^ )m (f(s, y(s),v(s)) 
-f(s,y(s),u(s)))))}dsdt + o(e 2 ). 

Hence, according to (3.11) and (3.15), it is easy to see that, there exists an ei > 0 such 
that J(u e (-)) — J(u(-)) > 0, for all u e f) £ U a d with d{u e {-),u{-)) = e < e\. This completes 
the proof of Theorem 3.2. □ 


6.3 Proofs of Theorems 3.3 and 3.4 


In this subsection, we shall prove Theorems 3.3 and 3.4. 

To begin with, let us recall the following known result ([1, Theorem 20.3, p. 297]): 


Lemma 6.1 Let F : U —)• M. be a continuous mapping having smooth restrictions to 
finite-dimensional submanifolds of U, where U is an open subset of a Banach space, and 
Ai is an n-dimensional, smooth differential manifold. Let u £U be a corank one critical 
point of F, i.e. the codimension of IrnDuF (the image of the differential of F at u) is 
equal to 1. Let A £ (IrnDuF) -1 = {?? Tp^-M; r/(X) = 0,V X £ ImD^F C T F ^)A 4}, 
A / 0. If the quadratic form XHess^F : ker D^F x ker D^F —> 1R is sign-indefinite, which 
is defined by 


/ d 2 \ 

A HesSuF(v,v) = \[^ Q F(<p(e)) J, Vv £ KerD^F C T~ a U, (6.41) 
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with ip : [0, eo) —> U (eo > 0) satisfying ip(0) = u and ^ 99 (e) = v, then F is locally open 
at u, i.e. F{u ) G intF{Oy) for any neighborhood O-a CU of u. 

We are now in a position to prove Theorem 3.3. 

Proof of Theorem 3.3 Similarly to [1], we introduce an extended system associated 
to problem (1.1) and (1.2) as follows: 

*(!$) = ($£»)■ ^)£U,a.e.te(0,n 

(y 0 m = (o\ 

V y(.°) J \yoJ ‘ 

Define the endpoint mapping E : L 2 (0, T; [/) —> JR x Af for the system (6.42) by 

E i U (')) = (y(T;i(.))) ’ ^ 

where y(-;u(-)) is the solution to (1.1) associated to the control it(-). Then, we define the 
attainable set of (6.42) at time T by 

.4 = {£(«(•)); «(•) e T 2 (0,T;[/)}. 

Since u(-) is optimal for Problem II, we have ([1, Section 12.4, p. 179]) 

£(«(•)) G 94. (6.44) 

For any u(-) € L 2 (0,T; M m ), let y e (-) be the solution to (1.1) corresponding to the 
control u(-) + ev(-) with small e > 0. 

Firstly, we claim that 


d_ 

de 




y(t) = 2V(t), t € [0,71, 


(6.45) 


where P(-) and T(-) are the solutions to (5.21) and (5.22), respectively. 

In fact, for any t € [0, T], set 

VS) = { if P^y e (*)) > °> (6.46) 

1 0 , if p(y(t),y e (t)) = 0 , 

where VS) = ex Py(t) 2/ e (^) with e > 0 being small enough. Define 

ri{6-,e) = expy {t) (9V e (t)), 0 G [0, p{y(t), y e (t)\. (6.47) 

Then, we have 77 (0; e) = y(f) and i](p(y(t),y e (t))] e) = y e (i). For any h € C°°(M ), applying 
Taylor’s expansion, Lemma 2.1, (2.17), (5.23) and (5.24), we obtain that 


d_ 

de 


»(»'(*)) 


/(*)W = We = }™ 0 

h(ri(p(y(t),y e (t))-,e)) —hfrj(0;e) 

= lim —------ 


-Ky{t)) 


e->0 




e —>0 

= li mi(V/i(j/(f)),V e (i)) = F (t)(h), 

e —>0 e 
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which implies the first equality of (6.45). 

To prove the second equality of (6.45), we employ two ways to compute 
On one hand, 


d 2 

dp 


0 Hy e (t))- 


d 2 

8P 


= lim ^| 0 (V/i(y e (t)), f y e (t)} 

= \v v{t) Vh, V(t)) + {Vh(y(t)),-H?\ n V e (t))r 


(6.48) 


where the first equality of (6.45) is used. 

On the other hand, recalling (6.46) and (6.47), we can get, via Taylor’s expansion, 
(2.17) and (5.23), 


d 2 

aP 


My e (t)) 


lim jz ( [h(y 2e (t )) - 2 h(y e (t)) + h{y(t ))) 

- /i(r?(0;2e)) -2 \h(y{p{y{t),y e {t))-,e)) 


e —>0 

— h 


(jl{ °; e))]} 

^{(Vhim, ffl 0 ??((9; 2e)) / o(j/(i), 2 / 2e (i)) + ±-§^\ o h(r)(6-,2e))p 2 {y{t),y 2e (t)) 
-2 (Vh(y(t)), $ Q y{d; e))p{y{t),y € {t)) - ^ h{y(6] e))p 2 {y{t),y e (t)) + o(e 2 )}. 


Since 


8 = iLw*'#, w’ me)) = 7(MYWP m) 


d9 2 


(Vyr t) Vh,V e (t)), 


where we have used Lemma 2.1 and the fact that /3(-;e) is a geodesic. Thus, by using the 
above equality and (5.23), we can get 


d 2 
dP 


My e (t)) 


= lim ^((V/z(y(f)), I/ 2e (t)> + ±(V V2e{t) Vh,V 2e (t)) - 2 (Vh(y(t)),V e (t)) 

— (Vy e( qV/i, V e {t)) + o(e 2 )) 

= lim^[(Vh(y(t)),2eV(t)+4e 2 Y(t)) + ±(V 2e y (t)+4£ 2 y(t) V/i, 2eV(t) + Ae 2 Y(t)) 
—2(Vh(y(t)), eV(t) + e 2 Y(t)) - <V eV(t)+e2y(t) V/z, eV(t) + e 2 Y(t)) + o(e 2 )) 

= 2 (Vh(y(t)),Y(t)) + (V v{t) Vh,V(t)). 


Combining this equality with (6.48), one can get the second equality of (6.45). 

Secondly, we claim that {y, ij){) T € (—oo, 0] x T* { M belongs to {ImDy.^E) 1 - if and only 
if it satisfies (3.19), where ’ijj(-) is the solution to (3.7) corresponding to the pair (z/,-i/’i). 
Thus, by the conditions of Theorem 3.3, the codimension of ImD u yE is 1. 

In fact, assume that (z/, V’l) £ (—oo,0] x T* n M satisfies (3.19). Recalling (3.4), one can 
further get 


vV u f°[tMt)) + V u f[t\$(t)Mt)) = 0, a.e. t € [0, T], V u(-) G L 2 (0, T; JET). (6.49) 
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Integrating (6.49) over [0,T], we can obtain, via (5.21), (3.7), (6.45) and integration by 
parts, 


o = fo T + v m v$(t)) - V x f[tmt),V(t))}dt 

= MV(T)) + f 0 T {vV u f°[t](v(t)) - V m $(V) - V*/[t]$(t), V(t))}dt 
= "Jo (^uf°[t}(v(t)) + d x f 0 [t ( V(t)j)dt + MV(T )) (6.50) 

= U £\ 0 J ( U (-) + e O) + Mm 0 y e ( T )) 

= (^V’i) t (Az(-)-E'M-)))- 

Since v(-) £ L 2 (0,T; JR m ) is arbitrarily chosen, we have 

(i/,i/>i) T £ (IrnD^E)- 1 . (6.51) 

Conversely, if (i/,V’i) T £ (ImD u ^E) 1 - with v < 0, one can follow the above argument 
in an inverse way, and get (3.19) with u = v and $(•) = ?/>(•), where V>(-) is the solution to 
(3.7) with v = v and V’l = V’l- 

Thirdly, according to (6.44), the above argument and Lemma 6.1, (i/, V>i ) T Hess u t\E 
is sign-definite on KerD u ^E x KerD a ^E. Now, we need to compute explicitly both 
Hess U (.)E and KerD n ^E. 

Recalling (6.41), (6.43) and (6.45), we have 

Hess^.)E(v(-),v(-)) = (^,V’i) T (£| Q £(h(-) + eu(-))) 

= ^| o J(u(-) + eu(-))+2V’i(r(T)). 

Applying (6.45), we can get 

/(«( 0 ) 

= "m 0 fo {(Vxf°{t,y e {t),u(t) + ev(t)), ^y e (t)) + V u f°(t,y e (t),u(t) + ev{t))(v(t))}dt 
= "Jo {v 2 J 0 [tmt),V(t)) + 2V x V u f°[t](v(t),V(t)) + Vlf°[tMt),v(t)) 

+ (V x f°[t),2Y(t))}dt. 

(6.53) 

Using integration by parts and employing the second order variational equation (5.22), we 
obtain that 

2Vh (Y(T)) 

= 2 f 0 T [v m ^(Y(t)) +$(t)(y m Y)\dt 
= 2fo \v m ^(Y(t)) + V x /[iMt),y(t)) + V u V x f[t](m,V{t),v(t)) 

f[t],V(t)) + \Vlf[t\($(t),V{t),V{t)) + ±\7lf[t}(i’(t),v(t),v(t))}dt. 
Inserting the above identity and (6.53) into (6.52), one can get, via the first order dual 
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equation (3.7), 


iy, AVHess^.)E(v(-), v(-)) 

= fo T {ylH v (t, v(t), ^(t),u(t)){V (t), V(t)) + V 2 u H u {t , y(t),^(t),u(t))(v(t),v(t)) 
+2V tt V x iP(t, y(t),m,u(t))(V(t),v(t)) - R$(t), V(t), f[t],V(t))}dt. 


By the definition of the kernel of D U ^E, for any v(-) £ KerD^E, one has 


f) — — 

u — de 


/ 0 T f°(t,y e (t),u(t)+ev(t))dt \ 
y e (T) ) 


= ( /o T {< v -/ 0 M^( t )>+ v -/ 0 M("( t ))}^ 

V(T) 


(6.54) 


In the normal case, i.e. v < 0, (6.54) implies, together with the first order dual equation 
(3.7) and (5.21), V(T) = 0 and / 0 7 V u H u [t](v(t))dt = 0. By (3.19), it follows that 


KerD a (.)E = (u(-) G L 2 (0, T;lR m ); (3.20) with £(•) = v(-) admits a solution}. (6.55) 


In order to determine the sign of the quadratic (is, ipi) T Hess u yE, from the assump¬ 
tions, one can find a u y (-) € V a d \ {«(•)} such that ||tt r) (-) — fi(-)llL 2 (o,T;iR m ) tends to zero 
as r] —> +oo. Set 




v„(- = 


,(■)-*(■) 


K(0 ~ ' u (')IIl 2 (0,T;K" 


e ri ~ \\ u ri(-) ~ u (')\\L 2 (0,T-,]R m )- 


Since D^E : L 2 (0,T; M m ) -> M x T yi M is linear, one can find a subspace N C 
L 2 (0,T; JR m ) such that L 2 (0,T;lR m ) = KerD^E © N, ImD^E = ( D U( . ) E)N , and 
Dy(.\ : N —> ]R x T yi M is surjective. Thus, we have dimIV < oo. For each v v (-), there 
exist a v y (-) £ KerD a yE and a v 2 (-) £ N such that v v (-) = v y (-) + v 2 (-). In what follows, 
we will consider two cases. 

Case I. If there exists an n\ > 0 such that v 2 (-) £ N \ {0} for all n > n\, then one 
can find a subsequence of |u 2 (-)} (still denoted by {u 2 (-)}) and a v 2 (-) £ N such that 


K(‘) “ ^ 2 (-)IIl2(0,T;JP") = 0. (6.56) 

We claim that v 2 (-) = 0. 

Indeed, denote by V y {-) and V 2 (-) the solutions to the first order variational equation 
(5.21) with v(-) = v y (-) for 7 = 1,2 and u(-) = v 2 (-), respectively. Especially, applying 
(6.56), we have 

lim max \V 2 (t) — V 2 (t)\ = 0. (6.57) 

rj^+oote[0,T] V 

Denote by V v (-) = V y (-) + V 2 (-). One can check that V y (-) is the solution to (5.21) with 
v(-) = v v (-) = v y (-) + v 2 {-). Denote by y y (-) the solution to (1.1) with cotrol u(-) = 
u(-) + ev v (-) for e > 0. Set V^ j£ (i) = exp y y(y y (t)) for t £ [0,T]. Applying (5.23), one can 
obtain 

V v , e (t) = eV v (t) + e 2 Y n (t) + o(e 2 ), V t G [0, T], 
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where Y n (-) is the solution to (5.22) with V(-) = V v (-) and v(-) = v v (-). Recalling the 
proof of Proposition 5.2, one can check that e 2 y r? (t) + o(e 2 ) in the above formula is an 
infinitesimal o(e), which is uniform with respect to v v (-), due to H^(')llL 2 (o,T;iR m ) = 1. 
Note that u v (-) = u{-) + e^v^-) G V a d, u*(-) G KerD n ^E and (6.55). The above formula 
holds for e = e v and 

0 = Y tl ,e v (T) = e v V 2 (T) + o(e v ), 77 = m + l,ni + 2, • • •. 

From the above formula and (6.57), one can get V 2 (T) = 0, and hence u 2 (-) G KerD U (.)Er I 
N, which implies the claim. 

Applying Taylor’s expansion, and noting (6.45) and (6.51) and the boundness of {u r? (-)} 
in L 2 (0,T; M m ), one can get 

i/(j(u(-) + eu ?? (-)) - J(u(-))) + Vh {V v ,e( T )) 

= e(v(pu(. ) j}vr,(-)+$i(V ri (T))') + ±e 2 (vHesSu(.)J{vn(-), v v (-)) + Mm? 0 ^( T ))) 
+o(e 2 ) 

= e(y^i V ( D u(-)Ev v (-j) + ^e 2 (iy,'i/j 1 ) T Hess ii{ . ) E(v v (-),v ri (-)) + o(e 2 ) 

= |e 2 (zh V’i) T ^ess s( .)F;(^(-), ^(-)) + e 2 (i/, ipi) T Hess^E^-), u 2 (-)) 

+ie 2 (z/,V’i) T i7ess s( . ) F;(7; 2 (-),r' 2 (-)) + o(e 2 )- 

(6.58) 

Taking e = e v in the above formula, we have, via u < 0, y 7] n (T) = y\. (6.51) and the 
optimality of u(-), 

0 > ) T Hess^E^-)^ 1 ^-)) + (i/,^i) T i7ess s( .)F;(^(-),u 2 (-)) 5Q . 

Vh) T 77ess s( .)£(u 2 (0, r; 2 (-)) + o(l)- 

By means of the boundedness of {t; 2 (-)} in L 2 (0,T;lR m ), there exists a subsequence of 
{(z/,'0i) T i7es% ( . ) F;(^(-),^(-))} (still denoted by {( 1 /,'0i) T i7es% ( . ) £;(^(-),^(-))} ) such 
that lim^+oo (u, ipi) T Hess^yE^v^-), u*(-)) = £ exists. Taking limit in (6.59) as ?y —> + 00 , 
one can get, via (6.56), 0 > Since ) T Hess^E is sign definite on KerD u ^E, 
we get iy^\) T Hess^yE is negative definite on KerD n ^E. 

Case II. There exists a subsequence of {t>,,(•)} (still denoted by {f; T) (-)} ) such that 
v v (-) G KerD U (.)E. Applying the same argument as that in (6.58) and (6.59), one can get 
(v , ,'ipi) T Hess^yE is negative definite on KerD^E. 

In the abnormal case, i.e. v = 0, KerD^E is equal to (3.22). Lemma 6.1 concludes 
that the left hand of (3.21) is sign-definite on (3.22). □ 

Finally, let us prove Theorem 3.4. 

Proof of Theorem 3.4 Theorem 3.4 is a direct consequence of [1, Theorem 21.8, 
p. 347], □ 


50 



References 

[1] A. A. Agrachev and Y. L. Sachkov, Control Theory from the Geometric Viewpoint, 
Encyclopaedia of Mathematical Sciences, vol. 87, Springer-Verlag, Berlin, 2004. 

[2] D. J. Bell and D. H. Jacobson, Singular Optimal Control Problems, Academic Press, 
London-New York, 1975. 

[3] J. F. Bonnans and A. Hermant, Second-order Analysis for Optimal Control Problems 
with Pure State Constraints and Mixed Control-State Constraints, Ann. Inst. H. 
Poincare Anal. Non Lineaire, 26 (2009), 561-598. 

[4] J. F. Bonnans and A. Hermant, No-gap Second-order Optimality Conditions for Op¬ 
timal Control Problems with a Single State Constraint and Control, Math. Program., 
Ser. B, 117 (2009) 21-50. 

[5] B. Bonnard, J. B. Caillau and E. Trelat, Second Order Optimality Conditions in the 
Smooth Case and Applications in Optimal Control, ESAIM Control Optim. Calc. 
Var., 13 (2007), 207-236. 

[6] B. Bonnard and M. Chyba, Singular Trajectories and Their Role in Control Theory, 
Mathematiques & Applications, vol. 40, Springer-Verlag, Berlin, Heidelberg, New 
York, 2003. 

[7] U. Boscain and B. Piccoli, Optimal Syntheses for Control Systems on 2 -D Manifolds, 
Mathematiques & Applications, vol. 43, Springer-Verlag, Berlin, Heidelberg, New 
York, 2004. 

[8] D. J. Clements and B. D. O. Anderson, Singular Optimal Control: the Linear- 
Quadratic Problem, Springer-Verlag, Berlin, New York, 1978. 

[9] Q. Cui, L. Deng and X. Zhang, Pointwise Second Order Necessary Conditions for 
Optimal Control Problems Evolved on Riemannian Manifolds, C. R. Math. Acad. 
Sci. Paris, Ser. I, 354 (2016), 191-194. 

[10] L. Deng, Dynamic Programming Method for Control Systems on Manifolds and its 
Relations to Maximum Principle, J. Math. Anal. Appl, 434 (2016), 915-938. 

[11] M. P. do Carrno, Differential Geometry of Curves and Surfaces, Prentice-Hall, Inc., 
Englewood Cliffs, New Jersey, 1976. 

[12] M. P. do Carmo, Riemannian Geometry, Translated from the Second Portuguese 
Edition by F. Flaherty, Mathematics: Theory & Applications, Birkhauser Boston, 
Inc., Boston, MA, 1992. 

[13] H. Frankowska and D. Tonon, Pointwise Second-order Necessary Optimality Condi¬ 
tions for the Mayer Problem with Control Constraints, SIAM J. Control Optim., 51 
(2013), 3814-3843. 

[14] R. F. Gabasov and F. M. Kirillova, High Order Necessary Conditions for Optimality, 
SIAM J. Control, 10 (1972), 127-168. 


51 



[15] R. F. Gabasov and F. M. Kirillova, Singular Optimal Controls, Izdat. “Nauka”, 
Moscow, 1973. 

[16] B. S. Goh, The Second Variation for the Singular Bolza Problem, SIAM J. Control, 
4 (1966), 309-325. 

[17] B. S. Goh, Necessary Conditions for Singular Extremals Involving Multiple Control 
Variables, SIAM J. Control , 4 (1966), 716-731. 

[18] S. Helgason, Differential Geometry and Symmetric Spaces, Academic press, New York 
and London, 1962. 

[19] D. Hoehener, Variational Approach to Second-order Optimality Conditions for Con¬ 
trol Problems with Pure State Constraints, SIAM. J. Control Optim., 50 (2012), 
1139-1173. 

[20] D. Hoehener, Variational Approach to Second-order Sufficient Optimality Conditions 
in Optimal Control, SIAM. J. Control Optim., 52 (2014), 861-892. 

[21] H.-W. Knobloch, Higher Order Necessary Conditions in Optimal Control Theory, 
Springer-Verlag, Berlin-New York, 1981. 

[22] S. Kobayashi and K. Nomizu, Foundations of Differential Geometry, vol.l, Inter¬ 
science, New York London, 1963. 

[23] A. J. Krener, The High Order Maximal Principle and its Application to Singular 
Extremals, SIAM J. Control Optim., 15 (1977), 256-293. 

[24] J. M. Lee, Riemannian Manifolds: An Introduction to Curvature, Graduate Texts in 
Mathematics, vol. 176, Springer-Verlag, New York, 1997. 

[25] X. Li and J. Yong, Optimal Control Theory for Infinite-Dimensional Systems, Systems 
& Control: Foundations & Applications, Birkhauser Boston, Inc., Boston, MA, 1995. 

[26] H. Lou, Second-order Necessary/Sufficient Conditions for Optimal Control Problems 
in the Absence of Linear Structure, Discrete Contin. Dyn. Syst. Ser. B, 14 (2010), 
1445-1464. 

[27] K. Malanowski, Sufficient Optimality Conditions for Optimal Control Subject to State 
Constraints, SIAM J. Control Optim., 35 (1997), 205-227. 

[28] K. Malanowski, H. Maurer and S. Pickenhain, Second-order Sufficient Conditions for 
State-constrained Optimal Control Problems, J. Optim. Theory Appl., 123 (2004), 
595-617. 

[29] N. P. Osmolovskii and H. Maurer, Applications to Regular and Bang-Bang Control. 
Second-Order Necessary and Sufficient Optimality Conditions in Calculus of Varia¬ 
tions and Optimal Control, SIAM, Philadelphia, PA, 2012. 

[30] Z. Pales and V. Zeidan, Optimal Control Problems with Set-valued Control and State 
Constraints, SIAM J. Optim., 14 (2003), 334-358. 


52 



[31] P. Petersen, Riemannian Geometry, Second Edition, Graduate Texts in Mathematics, 
vol. 171, Springer-Verlag, New York, 2006. 

[32] L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze and E. F. Mischenko, Math¬ 
ematical Theory of Optimal Processes, Wiley, New York, 1962. 

[33] H. Schattler and U. Ledzewicz, Geometric Optimal Control, Theory, Methods and 
Examples, Interdisciplinary Applied Mathematics, vol. 38, Springer, New York, 2012. 

[34] H. J. Sussmann, Geometry and Optimal Control, in: Mathematical Control Theory, 
Calculus of Variations and Optimal Control, Optimization, Springer, New York, 1999, 
140-198. 

[35] J. Warga, A Second-order Condition that Strengthens Pontryagin’s Maximum Prin¬ 
ciple, J. Differential Equations, 28 (1978), 284-307. 

[36] H. Wu, C. L. Shen and Y. L. Yu, An Introduction to Riemannian Geometry (In 
Chinese), Press of Peking University, Beijing, 1989. 


53 



